python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 136840 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2627694'] with mtr_portfolio_ids : ['20957633'] and first list_photo_ids : [] new path : /proc/136840/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 3 ; length of list_pids : 3 ; length of list_args : 3 time to download the photos : 0.4205784797668457 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Mon Mar 3 04:20:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-03 04:20:31.356267: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-03 04:20:31.383255: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-03 04:20:31.385437: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7efda8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-03 04:20:31.385501: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-03 04:20:31.389640: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-03 04:20:31.623965: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2b4fbcf0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-03 04:20:31.624024: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-03 04:20:31.625521: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-03 04:20:31.625971: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-03 04:20:31.629301: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-03 04:20:31.632376: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-03 04:20:31.632822: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-03 04:20:31.639096: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-03 04:20:31.640393: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-03 04:20:31.646281: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-03 04:20:31.648187: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-03 04:20:31.648281: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-03 04:20:31.649063: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-03 04:20:31.649077: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-03 04:20:31.649086: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-03 04:20:31.650444: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-03 04:20:31.903881: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-03 04:20:31.904001: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-03 04:20:31.904016: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-03 04:20:31.904030: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-03 04:20:31.904044: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-03 04:20:31.904056: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-03 04:20:31.904069: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-03 04:20:31.904083: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-03 04:20:31.905241: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-03 04:20:31.906315: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-03 04:20:31.906342: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-03 04:20:31.906356: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-03 04:20:31.906368: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-03 04:20:31.906381: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-03 04:20:31.906393: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-03 04:20:31.906405: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-03 04:20:31.906417: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-03 04:20:31.907564: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-03 04:20:31.907598: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-03 04:20:31.907606: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-03 04:20:31.907613: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-03 04:20:31.908803: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-03 04:20:38.636457: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-03 04:20:38.819061: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 3 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.55547 max: 149.10391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 715 time to create 1 rle with old method : 0.0014066696166992188 length of segment : 66 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 821 time to create 1 rle with old method : 0.001529693603515625 length of segment : 34 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 441 time to create 1 rle with old method : 0.0008924007415771484 length of segment : 29 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 725 time to create 1 rle with old method : 0.0013682842254638672 length of segment : 68 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 977 time to create 1 rle with old method : 0.0017719268798828125 length of segment : 42 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.0005888938903808594 length of segment : 30 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 657 time to create 1 rle with old method : 0.0012269020080566406 length of segment : 38 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.98516 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 467 time to create 1 rle with old method : 0.0006368160247802734 length of segment : 27 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 912 time to create 1 rle with old method : 0.001142740249633789 length of segment : 40 time for calcul the mask position with numpy : 8.726119995117188e-05 nb_pixel_total : 2023 time to create 1 rle with old method : 0.002675294876098633 length of segment : 62 time for calcul the mask position with numpy : 0.0001533031463623047 nb_pixel_total : 6794 time to create 1 rle with old method : 0.008377313613891602 length of segment : 71 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002636909484863281 length of segment : 36 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 2287 time to create 1 rle with old method : 0.0028367042541503906 length of segment : 55 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 918 time to create 1 rle with old method : 0.0012054443359375 length of segment : 38 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.36406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 9.131431579589844e-05 nb_pixel_total : 3290 time to create 1 rle with old method : 0.004326581954956055 length of segment : 63 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 522 time to create 1 rle with old method : 0.0008330345153808594 length of segment : 15 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 966 time to create 1 rle with old method : 0.00130462646484375 length of segment : 70 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 1370 time to create 1 rle with old method : 0.0017282962799072266 length of segment : 32 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 1268 time to create 1 rle with old method : 0.0015804767608642578 length of segment : 36 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.10234 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.0006172657012939453 length of segment : 37 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.0003154277801513672 length of segment : 24 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 222.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 104.38125 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 514 time to create 1 rle with old method : 0.0010144710540771484 length of segment : 18 time for calcul the mask position with numpy : 0.0009500980377197266 nb_pixel_total : 72377 time to create 1 rle with old method : 0.1009058952331543 length of segment : 295 Processing 1 images image shape: (400, 400, 3) min: 25.00000 max: 203.00000 molded_images shape: (1, 640, 640, 3) min: -90.33672 max: 88.25234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.12188 max: 149.65469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.0002181529998779297 length of segment : 13 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 2448 time to create 1 rle with old method : 0.0030775070190429688 length of segment : 50 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 472 time to create 1 rle with old method : 0.0006678104400634766 length of segment : 24 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 1170 time to create 1 rle with old method : 0.0014984607696533203 length of segment : 50 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0005269050598144531 length of segment : 18 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 1066 time to create 1 rle with old method : 0.0013506412506103516 length of segment : 47 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 364 time to create 1 rle with old method : 0.0005605220794677734 length of segment : 18 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.0005719661712646484 length of segment : 25 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.93438 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 719 time to create 1 rle with old method : 0.0009477138519287109 length of segment : 30 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 492 time to create 1 rle with old method : 0.0007436275482177734 length of segment : 20 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 741 time to create 1 rle with old method : 0.001074075698852539 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.66875 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 1759 time to create 1 rle with old method : 0.0023059844970703125 length of segment : 46 time for calcul the mask position with numpy : 9.512901306152344e-05 nb_pixel_total : 1709 time to create 1 rle with old method : 0.0021982192993164062 length of segment : 126 time for calcul the mask position with numpy : 8.893013000488281e-05 nb_pixel_total : 1372 time to create 1 rle with old method : 0.002482175827026367 length of segment : 45 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 1175 time to create 1 rle with old method : 0.0014357566833496094 length of segment : 37 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 685 time to create 1 rle with old method : 0.0008847713470458984 length of segment : 117 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 762 time to create 1 rle with old method : 0.0010166168212890625 length of segment : 37 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1065 time to create 1 rle with old method : 0.0014491081237792969 length of segment : 41 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 251.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 108.84609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 586 time to create 1 rle with old method : 0.0010232925415039062 length of segment : 68 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 215 time to create 1 rle with old method : 0.0004069805145263672 length of segment : 32 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 1035 time to create 1 rle with old method : 0.001695394515991211 length of segment : 105 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 1258 time to create 1 rle with old method : 0.002056121826171875 length of segment : 68 time for calcul the mask position with numpy : 0.00016498565673828125 nb_pixel_total : 4002 time to create 1 rle with old method : 0.004743337631225586 length of segment : 193 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.00042057037353515625 length of segment : 29 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 763 time to create 1 rle with old method : 0.0009968280792236328 length of segment : 31 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 1039 time to create 1 rle with old method : 0.0013973712921142578 length of segment : 63 Processing 1 images image shape: (280, 400, 3) min: 20.00000 max: 191.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 83.04922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0010938644409179688 nb_pixel_total : 98969 time to create 1 rle with old method : 0.12893390655517578 length of segment : 286 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.02578 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 3034 time to create 1 rle with old method : 0.004437923431396484 length of segment : 49 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 2386 time to create 1 rle with old method : 0.0036737918853759766 length of segment : 75 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.00040435791015625 length of segment : 20 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 987 time to create 1 rle with old method : 0.001293182373046875 length of segment : 41 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.00041866302490234375 length of segment : 59 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1746 time to create 1 rle with old method : 0.0023186206817626953 length of segment : 41 time for calcul the mask position with numpy : 7.724761962890625e-05 nb_pixel_total : 500 time to create 1 rle with old method : 0.0015156269073486328 length of segment : 22 time for calcul the mask position with numpy : 0.0002224445343017578 nb_pixel_total : 4405 time to create 1 rle with old method : 0.006238698959350586 length of segment : 90 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 891 time to create 1 rle with old method : 0.001524209976196289 length of segment : 25 time for calcul the mask position with numpy : 0.0001163482666015625 nb_pixel_total : 4180 time to create 1 rle with old method : 0.00608515739440918 length of segment : 79 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.72891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.00026988983154296875 length of segment : 17 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 753 time to create 1 rle with old method : 0.0009076595306396484 length of segment : 56 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 640 time to create 1 rle with old method : 0.0008289813995361328 length of segment : 34 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002605915069580078 length of segment : 15 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.0003371238708496094 length of segment : 19 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.0004031658172607422 length of segment : 16 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.00039505958557128906 length of segment : 16 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 313 time to create 1 rle with old method : 0.00045371055603027344 length of segment : 34 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.00043392181396484375 length of segment : 22 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 281 time to create 1 rle with old method : 0.0003993511199951172 length of segment : 22 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.97109 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.0003249645233154297 length of segment : 28 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 326 time to create 1 rle with old method : 0.0004892349243164062 length of segment : 17 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 22 time to create 1 rle with old method : 5.698204040527344e-05 length of segment : 6 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.0005984306335449219 length of segment : 27 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.28750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 18 time to create 1 rle with old method : 6.270408630371094e-05 length of segment : 5 time for calcul the mask position with numpy : 0.0004570484161376953 nb_pixel_total : 41765 time to create 1 rle with old method : 0.04686927795410156 length of segment : 243 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 52 time to create 1 rle with old method : 0.00010251998901367188 length of segment : 20 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.58672 max: 149.29141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 144 time to create 1 rle with old method : 0.0003342628479003906 length of segment : 34 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 434 time to create 1 rle with old method : 0.0005838871002197266 length of segment : 28 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 1255 time to create 1 rle with old method : 0.0016224384307861328 length of segment : 33 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 40 time to create 1 rle with old method : 0.00010657310485839844 length of segment : 3 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.34453 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 18 time for calcul the mask position with numpy : 0.00011849403381347656 nb_pixel_total : 5517 time to create 1 rle with old method : 0.0066394805908203125 length of segment : 62 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 847 time to create 1 rle with old method : 0.0011262893676757812 length of segment : 28 time for calcul the mask position with numpy : 0.0001838207244873047 nb_pixel_total : 1 time to create 1 rle with old method : 1.6927719116210938e-05 length of segment : 1 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 839 time to create 1 rle with old method : 0.0010771751403808594 length of segment : 34 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 991 time to create 1 rle with old method : 0.0013189315795898438 length of segment : 34 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 154 time to create 1 rle with old method : 0.00022292137145996094 length of segment : 18 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 1977 time to create 1 rle with old method : 0.002591848373413086 length of segment : 39 time for calcul the mask position with numpy : 8.988380432128906e-05 nb_pixel_total : 2776 time to create 1 rle with old method : 0.0037229061126708984 length of segment : 56 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 856 time to create 1 rle with old method : 0.0011267662048339844 length of segment : 41 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 929 time to create 1 rle with old method : 0.001195669174194336 length of segment : 34 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 1432 time to create 1 rle with old method : 0.0018069744110107422 length of segment : 62 time for calcul the mask position with numpy : 0.00013399124145507812 nb_pixel_total : 6971 time to create 1 rle with old method : 0.008841753005981445 length of segment : 63 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1220 time to create 1 rle with old method : 0.0016951560974121094 length of segment : 50 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 371 time to create 1 rle with old method : 0.0005002021789550781 length of segment : 27 time for calcul the mask position with numpy : 0.0001087188720703125 nb_pixel_total : 2384 time to create 1 rle with old method : 0.0029709339141845703 length of segment : 62 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 341 time to create 1 rle with old method : 0.0004620552062988281 length of segment : 23 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 2262 time to create 1 rle with old method : 0.002690553665161133 length of segment : 46 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 1077 time to create 1 rle with old method : 0.0013093948364257812 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -104.80156 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 485 time to create 1 rle with old method : 0.0007889270782470703 length of segment : 14 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 1269 time to create 1 rle with old method : 0.0015702247619628906 length of segment : 50 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 876 time to create 1 rle with old method : 0.0013682842254638672 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.03984 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 463 time to create 1 rle with old method : 0.0007545948028564453 length of segment : 52 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003247261047363281 length of segment : 23 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 119 time to create 1 rle with old method : 0.00024580955505371094 length of segment : 16 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 224.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 106.76406 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 539 time to create 1 rle with old method : 0.0007796287536621094 length of segment : 18 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 387 time to create 1 rle with old method : 0.0007295608520507812 length of segment : 47 time for calcul the mask position with numpy : 0.00011277198791503906 nb_pixel_total : 1575 time to create 1 rle with old method : 0.002308368682861328 length of segment : 32 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 819 time to create 1 rle with old method : 0.0010068416595458984 length of segment : 73 time for calcul the mask position with numpy : 0.0007588863372802734 nb_pixel_total : 74231 time to create 1 rle with old method : 0.08416533470153809 length of segment : 304 Processing 1 images image shape: (400, 400, 3) min: 24.00000 max: 201.00000 molded_images shape: (1, 640, 640, 3) min: -93.23125 max: 82.97500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0013887882232666016 nb_pixel_total : 147986 time to create 1 rle with old method : 0.1639258861541748 length of segment : 413 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.41094 max: 149.30703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 2206 time to create 1 rle with old method : 0.002955198287963867 length of segment : 47 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.0005352497100830078 length of segment : 16 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005877017974853516 length of segment : 18 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 99 time to create 1 rle with old method : 0.0001666545867919922 length of segment : 12 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.93438 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 488 time to create 1 rle with old method : 0.0007426738739013672 length of segment : 18 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 729 time to create 1 rle with old method : 0.0008974075317382812 length of segment : 30 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 652 time to create 1 rle with old method : 0.0009567737579345703 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.04375 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 1716 time to create 1 rle with old method : 0.002323627471923828 length of segment : 46 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 1651 time to create 1 rle with old method : 0.002031087875366211 length of segment : 109 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 1383 time to create 1 rle with old method : 0.0017862319946289062 length of segment : 46 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 1318 time to create 1 rle with old method : 0.0015869140625 length of segment : 42 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 246.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 105.29922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 215 time to create 1 rle with old method : 0.0003170967102050781 length of segment : 31 time for calcul the mask position with numpy : 0.00010061264038085938 nb_pixel_total : 653 time to create 1 rle with old method : 0.0009188652038574219 length of segment : 71 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 1722 time to create 1 rle with old method : 0.002324342727661133 length of segment : 166 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 1220 time to create 1 rle with old method : 0.0016818046569824219 length of segment : 70 time for calcul the mask position with numpy : 0.0002048015594482422 nb_pixel_total : 3883 time to create 1 rle with old method : 0.004732608795166016 length of segment : 188 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 348 time to create 1 rle with old method : 0.0004737377166748047 length of segment : 37 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.0003845691680908203 length of segment : 29 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 285 time to create 1 rle with old method : 0.00039005279541015625 length of segment : 29 Processing 1 images image shape: (280, 400, 3) min: 19.00000 max: 183.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 71.53359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009655952453613281 nb_pixel_total : 105189 time to create 1 rle with old method : 0.11623239517211914 length of segment : 282 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.51797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 2999 time to create 1 rle with old method : 0.0035974979400634766 length of segment : 80 time for calcul the mask position with numpy : 0.00014090538024902344 nb_pixel_total : 3491 time to create 1 rle with old method : 0.0045087337493896484 length of segment : 52 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 184 time to create 1 rle with old method : 0.0002899169921875 length of segment : 17 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 944 time to create 1 rle with old method : 0.001280069351196289 length of segment : 30 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 1361 time to create 1 rle with old method : 0.0017652511596679688 length of segment : 50 time for calcul the mask position with numpy : 0.0001385211944580078 nb_pixel_total : 6793 time to create 1 rle with old method : 0.00970602035522461 length of segment : 88 time for calcul the mask position with numpy : 0.00015211105346679688 nb_pixel_total : 5588 time to create 1 rle with old method : 0.009406089782714844 length of segment : 131 time for calcul the mask position with numpy : 0.0005736351013183594 nb_pixel_total : 34840 time to create 1 rle with old method : 0.04387617111206055 length of segment : 326 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.0003070831298828125 length of segment : 54 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0003807544708251953 length of segment : 58 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.56094 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.00035309791564941406 length of segment : 20 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.0002753734588623047 length of segment : 17 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 550 time to create 1 rle with old method : 0.0007576942443847656 length of segment : 37 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.00048351287841796875 length of segment : 23 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 627 time to create 1 rle with old method : 0.0010080337524414062 length of segment : 48 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.000400543212890625 length of segment : 16 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 264 time to create 1 rle with old method : 0.000392913818359375 length of segment : 17 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002472400665283203 length of segment : 14 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0004029273986816406 length of segment : 16 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 596 time to create 1 rle with old method : 0.0007138252258300781 length of segment : 47 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.04141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.0002048015594482422 length of segment : 33 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.0002980232238769531 length of segment : 24 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 349 time to create 1 rle with old method : 0.00046372413635253906 length of segment : 28 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 449 time to create 1 rle with old method : 0.0006303787231445312 length of segment : 21 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 41 time to create 1 rle with old method : 0.00015044212341308594 length of segment : 15 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.60000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00044655799865722656 nb_pixel_total : 38558 time to create 1 rle with old method : 0.04505777359008789 length of segment : 233 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 20 time to create 1 rle with old method : 5.364418029785156e-05 length of segment : 4 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 538 time to create 1 rle with old method : 0.0006966590881347656 length of segment : 33 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.17266 max: 149.69375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 733 time to create 1 rle with old method : 0.001069784164428711 length of segment : 61 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 728 time to create 1 rle with old method : 0.0010449886322021484 length of segment : 61 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 458 time to create 1 rle with old method : 0.0006241798400878906 length of segment : 35 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 343 time to create 1 rle with old method : 0.000469207763671875 length of segment : 26 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 769 time to create 1 rle with old method : 0.0010259151458740234 length of segment : 45 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 2059 time to create 1 rle with old method : 0.002635955810546875 length of segment : 41 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 1021 time to create 1 rle with old method : 0.0013790130615234375 length of segment : 49 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 1084 time to create 1 rle with old method : 0.0014507770538330078 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.21563 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00012445449829101562 nb_pixel_total : 6464 time to create 1 rle with old method : 0.007827520370483398 length of segment : 68 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 896 time to create 1 rle with old method : 0.0011761188507080078 length of segment : 32 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 924 time to create 1 rle with old method : 0.0012688636779785156 length of segment : 33 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 1510 time to create 1 rle with old method : 0.001912832260131836 length of segment : 78 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 2267 time to create 1 rle with old method : 0.002801656723022461 length of segment : 49 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 142 time to create 1 rle with old method : 0.00022840499877929688 length of segment : 16 time for calcul the mask position with numpy : 0.000370025634765625 nb_pixel_total : 6286 time to create 1 rle with old method : 0.009537220001220703 length of segment : 272 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -102.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 9.393692016601562e-05 nb_pixel_total : 645 time to create 1 rle with old method : 0.001764535903930664 length of segment : 25 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.0008859634399414062 length of segment : 13 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.97344 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.00035381317138671875 length of segment : 22 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.00048732757568359375 length of segment : 41 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 142 time to create 1 rle with old method : 0.00023508071899414062 length of segment : 17 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 225.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 106.38906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 525 time to create 1 rle with old method : 0.0007989406585693359 length of segment : 17 time for calcul the mask position with numpy : 0.0006861686706542969 nb_pixel_total : 62570 time to create 1 rle with old method : 0.07383966445922852 length of segment : 301 Processing 1 images image shape: (400, 400, 3) min: 25.00000 max: 202.00000 molded_images shape: (1, 640, 640, 3) min: -92.82500 max: 88.40469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.42266 max: 149.65469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.0005915164947509766 length of segment : 23 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 2346 time to create 1 rle with old method : 0.002948760986328125 length of segment : 50 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 447 time to create 1 rle with old method : 0.0006453990936279297 length of segment : 24 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 520 time to create 1 rle with old method : 0.0007472038269042969 length of segment : 21 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 108 time to create 1 rle with old method : 0.00017309188842773438 length of segment : 13 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 501 time to create 1 rle with old method : 0.0006873607635498047 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.01641 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 668 time to create 1 rle with old method : 0.001184701919555664 length of segment : 29 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 880 time to create 1 rle with old method : 0.0016336441040039062 length of segment : 23 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 562 time to create 1 rle with old method : 0.001134634017944336 length of segment : 22 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 875 time to create 1 rle with old method : 0.0015478134155273438 length of segment : 53 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.16094 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 1863 time to create 1 rle with old method : 0.002352476119995117 length of segment : 51 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 1272 time to create 1 rle with old method : 0.0015664100646972656 length of segment : 42 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1233 time to create 1 rle with old method : 0.0015311241149902344 length of segment : 37 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 1633 time to create 1 rle with old method : 0.001991748809814453 length of segment : 117 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1041 time to create 1 rle with old method : 0.0015239715576171875 length of segment : 41 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 1383 time to create 1 rle with old method : 0.0017189979553222656 length of segment : 46 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 781 time to create 1 rle with old method : 0.0009760856628417969 length of segment : 37 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 238.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 100.31875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 516 time to create 1 rle with old method : 0.0007073879241943359 length of segment : 64 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002734661102294922 length of segment : 28 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 1559 time to create 1 rle with old method : 0.0019462108612060547 length of segment : 132 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 1246 time to create 1 rle with old method : 0.001659393310546875 length of segment : 62 time for calcul the mask position with numpy : 0.0001704692840576172 nb_pixel_total : 3895 time to create 1 rle with old method : 0.004637241363525391 length of segment : 190 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 289 time to create 1 rle with old method : 0.0003914833068847656 length of segment : 30 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 394 time to create 1 rle with old method : 0.0005247592926025391 length of segment : 35 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 383 time to create 1 rle with old method : 0.0005059242248535156 length of segment : 34 Processing 1 images image shape: (280, 400, 3) min: 22.00000 max: 189.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 72.83437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009412765502929688 nb_pixel_total : 104402 time to create 1 rle with old method : 0.12024974822998047 length of segment : 284 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.86562 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 0.00010704994201660156 nb_pixel_total : 4213 time to create 1 rle with old method : 0.005658626556396484 length of segment : 83 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.0002789497375488281 length of segment : 17 time for calcul the mask position with numpy : 0.00013971328735351562 nb_pixel_total : 8314 time to create 1 rle with old method : 0.009976387023925781 length of segment : 92 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 482 time to create 1 rle with old method : 0.0006978511810302734 length of segment : 31 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.0003185272216796875 length of segment : 54 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 966 time to create 1 rle with old method : 0.001317739486694336 length of segment : 25 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 836 time to create 1 rle with old method : 0.0010483264923095703 length of segment : 42 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 53 time to create 1 rle with old method : 0.00010466575622558594 length of segment : 8 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 1302 time to create 1 rle with old method : 0.0016891956329345703 length of segment : 42 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 3928 time to create 1 rle with old method : 0.004576683044433594 length of segment : 55 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 37 time to create 1 rle with old method : 7.653236389160156e-05 length of segment : 7 time for calcul the mask position with numpy : 0.0004329681396484375 nb_pixel_total : 31856 time to create 1 rle with old method : 0.03556680679321289 length of segment : 268 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.81484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 184 time to create 1 rle with old method : 0.0002830028533935547 length of segment : 16 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003654956817626953 length of segment : 20 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 667 time to create 1 rle with old method : 0.0008952617645263672 length of segment : 39 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.00037407875061035156 length of segment : 23 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0003981590270996094 length of segment : 16 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0003936290740966797 length of segment : 16 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.00030112266540527344 length of segment : 15 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 698 time to create 1 rle with old method : 0.0008327960968017578 length of segment : 53 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.00625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.0003147125244140625 length of segment : 25 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.00037789344787597656 length of segment : 26 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 54 time to create 1 rle with old method : 9.417533874511719e-05 length of segment : 20 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 460 time to create 1 rle with old method : 0.0006761550903320312 length of segment : 22 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 64 time to create 1 rle with old method : 0.00014281272888183594 length of segment : 9 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.53750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 15 time to create 1 rle with old method : 5.125999450683594e-05 length of segment : 3 time for calcul the mask position with numpy : 0.0004439353942871094 nb_pixel_total : 39539 time to create 1 rle with old method : 0.0448758602142334 length of segment : 268 Detection mask done ! Trying to reset tf kernel 137326 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4726 tf kernel not reseted sub process len(results) : 234 len(list_Values) 234 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 234 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9709 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 234 chid ids of type : 4228 Number RLEs to save : 12860 save missing photos in datou_result : time spend for datou_step_exec : 24.24099063873291 time spend to save output : 1.4537723064422607 total time spend for step 1 : 25.69476294517517 step2:brightness Mon Mar 3 04:20:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1740972028_136840_1340529049_b04178e508c97281f6faa54675a68251.jpg treat image : temp/1740972028_136840_1340529032_12616e8ec02ae8d1f06f8f417db11934.jpg treat image : temp/1740972028_136840_1340529031_36377c6fbe602e5538078b1ef3e87a6d.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.014721155166625977 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.012683629989624023 save missing photos in datou_result : time spend for datou_step_exec : 1.6205196380615234 time spend to save output : 0.038469552993774414 total time spend for step 2 : 1.6589891910552979 step3:blur_detection Mon Mar 3 04:20:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1740972028_136840_1340529049_b04178e508c97281f6faa54675a68251.jpg resize: (1080, 1920) 1340529049 -7.48735850264301 treat image : temp/1740972028_136840_1340529032_12616e8ec02ae8d1f06f8f417db11934.jpg resize: (1080, 1920) 1340529032 -7.499733103714181 treat image : temp/1740972028_136840_1340529031_36377c6fbe602e5538078b1ef3e87a6d.jpg resize: (1080, 1920) 1340529031 -7.500327883717034 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.012893438339233398 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.019257783889770508 save missing photos in datou_result : time spend for datou_step_exec : 3.2088046073913574 time spend to save output : 0.037871599197387695 total time spend for step 3 : 3.246676206588745 step4:rle_unique_nms_with_priority Mon Mar 3 04:20:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 234 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 77 nb_hashtags : 6 time to prepare the origin masks : 1.1418836116790771 time for calcul the mask position with numpy : 0.07334423065185547 nb_pixel_total : 1794730 time to create 1 rle with new method : 0.35494112968444824 time for calcul the mask position with numpy : 0.008692264556884766 nb_pixel_total : 72377 time to create 1 rle with old method : 0.0766444206237793 time for calcul the mask position with numpy : 0.008086681365966797 nb_pixel_total : 715 time to create 1 rle with old method : 0.0008382797241210938 time for calcul the mask position with numpy : 0.0077362060546875 nb_pixel_total : 34 time to create 1 rle with old method : 5.316734313964844e-05 time for calcul the mask position with numpy : 0.008095741271972656 nb_pixel_total : 137 time to create 1 rle with old method : 0.00017762184143066406 time for calcul the mask position with numpy : 0.007979631423950195 nb_pixel_total : 7 time to create 1 rle with old method : 2.6226043701171875e-05 time for calcul the mask position with numpy : 0.007641315460205078 nb_pixel_total : 821 time to create 1 rle with old method : 0.0008380413055419922 time for calcul the mask position with numpy : 0.00774073600769043 nb_pixel_total : 58 time to create 1 rle with old method : 9.512901306152344e-05 time for calcul the mask position with numpy : 0.007798433303833008 nb_pixel_total : 977 time to create 1 rle with old method : 0.0010530948638916016 time for calcul the mask position with numpy : 0.007721662521362305 nb_pixel_total : 163 time to create 1 rle with old method : 0.0001938343048095703 time for calcul the mask position with numpy : 0.008055686950683594 nb_pixel_total : 467 time to create 1 rle with old method : 0.0004909038543701172 time for calcul the mask position with numpy : 0.007909536361694336 nb_pixel_total : 359 time to create 1 rle with old method : 0.00044608116149902344 time for calcul the mask position with numpy : 0.007666826248168945 nb_pixel_total : 2023 time to create 1 rle with old method : 0.0021643638610839844 time for calcul the mask position with numpy : 0.007632017135620117 nb_pixel_total : 3290 time to create 1 rle with old method : 0.0037682056427001953 time for calcul the mask position with numpy : 0.008055448532104492 nb_pixel_total : 966 time to create 1 rle with old method : 0.0010819435119628906 time for calcul the mask position with numpy : 0.007963180541992188 nb_pixel_total : 6794 time to create 1 rle with old method : 0.0077972412109375 time for calcul the mask position with numpy : 0.008079051971435547 nb_pixel_total : 227 time to create 1 rle with old method : 0.0002474784851074219 time for calcul the mask position with numpy : 0.008106708526611328 nb_pixel_total : 912 time to create 1 rle with old method : 0.001012563705444336 time for calcul the mask position with numpy : 0.00821375846862793 nb_pixel_total : 42 time to create 1 rle with old method : 7.43865966796875e-05 time for calcul the mask position with numpy : 0.008124828338623047 nb_pixel_total : 384 time to create 1 rle with old method : 0.0004150867462158203 time for calcul the mask position with numpy : 0.00793147087097168 nb_pixel_total : 522 time to create 1 rle with old method : 0.0005621910095214844 time for calcul the mask position with numpy : 0.00787210464477539 nb_pixel_total : 42 time to create 1 rle with old method : 8.487701416015625e-05 time for calcul the mask position with numpy : 0.007938385009765625 nb_pixel_total : 1370 time to create 1 rle with old method : 0.0014221668243408203 time for calcul the mask position with numpy : 0.007832765579223633 nb_pixel_total : 514 time to create 1 rle with old method : 0.0005927085876464844 time for calcul the mask position with numpy : 0.007989645004272461 nb_pixel_total : 719 time to create 1 rle with old method : 0.0007474422454833984 time for calcul the mask position with numpy : 0.00806879997253418 nb_pixel_total : 762 time to create 1 rle with old method : 0.0007712841033935547 time for calcul the mask position with numpy : 0.007904529571533203 nb_pixel_total : 215 time to create 1 rle with old method : 0.00022792816162109375 time for calcul the mask position with numpy : 0.007785320281982422 nb_pixel_total : 1372 time to create 1 rle with old method : 0.001491546630859375 time for calcul the mask position with numpy : 0.007968902587890625 nb_pixel_total : 17 time to create 1 rle with old method : 2.4080276489257812e-05 time for calcul the mask position with numpy : 0.008008241653442383 nb_pixel_total : 296 time to create 1 rle with old method : 0.00032329559326171875 time for calcul the mask position with numpy : 0.007956504821777344 nb_pixel_total : 763 time to create 1 rle with old method : 0.0008594989776611328 time for calcul the mask position with numpy : 0.007630109786987305 nb_pixel_total : 586 time to create 1 rle with old method : 0.0005996227264404297 time for calcul the mask position with numpy : 0.0078105926513671875 nb_pixel_total : 4002 time to create 1 rle with old method : 0.004026174545288086 time for calcul the mask position with numpy : 0.007965564727783203 nb_pixel_total : 967 time to create 1 rle with old method : 0.0010340213775634766 time for calcul the mask position with numpy : 0.007807731628417969 nb_pixel_total : 251 time to create 1 rle with old method : 0.0002777576446533203 time for calcul the mask position with numpy : 0.0077974796295166016 nb_pixel_total : 1759 time to create 1 rle with old method : 0.0019221305847167969 time for calcul the mask position with numpy : 0.007848501205444336 nb_pixel_total : 492 time to create 1 rle with old method : 0.0005512237548828125 time for calcul the mask position with numpy : 0.007854938507080078 nb_pixel_total : 1709 time to create 1 rle with old method : 0.0019154548645019531 time for calcul the mask position with numpy : 0.007934331893920898 nb_pixel_total : 1035 time to create 1 rle with old method : 0.0011494159698486328 time for calcul the mask position with numpy : 0.008062601089477539 nb_pixel_total : 685 time to create 1 rle with old method : 0.0007798671722412109 time for calcul the mask position with numpy : 0.0078887939453125 nb_pixel_total : 389 time to create 1 rle with old method : 0.0004482269287109375 time for calcul the mask position with numpy : 0.00801229476928711 nb_pixel_total : 739 time to create 1 rle with old method : 0.0008530616760253906 time for calcul the mask position with numpy : 0.00791788101196289 nb_pixel_total : 356 time to create 1 rle with old method : 0.0003952980041503906 time for calcul the mask position with numpy : 0.008015632629394531 nb_pixel_total : 15 time to create 1 rle with old method : 4.029273986816406e-05 time for calcul the mask position with numpy : 0.007971048355102539 nb_pixel_total : 2448 time to create 1 rle with old method : 0.002669095993041992 time for calcul the mask position with numpy : 0.007959127426147461 nb_pixel_total : 1065 time to create 1 rle with old method : 0.0012011528015136719 time for calcul the mask position with numpy : 0.0078122615814208984 nb_pixel_total : 1170 time to create 1 rle with old method : 0.0013515949249267578 time for calcul the mask position with numpy : 0.008319854736328125 nb_pixel_total : 20 time to create 1 rle with old method : 3.910064697265625e-05 time for calcul the mask position with numpy : 0.008377790451049805 nb_pixel_total : 472 time to create 1 rle with old method : 0.0005757808685302734 time for calcul the mask position with numpy : 0.008386850357055664 nb_pixel_total : 133 time to create 1 rle with old method : 0.00016188621520996094 time for calcul the mask position with numpy : 0.008696556091308594 nb_pixel_total : 98969 time to create 1 rle with old method : 0.1110846996307373 time for calcul the mask position with numpy : 0.008331775665283203 nb_pixel_total : 4405 time to create 1 rle with old method : 0.004950761795043945 time for calcul the mask position with numpy : 0.008202552795410156 nb_pixel_total : 52 time to create 1 rle with old method : 6.747245788574219e-05 time for calcul the mask position with numpy : 0.0076982975006103516 nb_pixel_total : 326 time to create 1 rle with old method : 0.0003497600555419922 time for calcul the mask position with numpy : 0.007956743240356445 nb_pixel_total : 891 time to create 1 rle with old method : 0.0010085105895996094 time for calcul the mask position with numpy : 0.007965087890625 nb_pixel_total : 41765 time to create 1 rle with old method : 0.04394650459289551 time for calcul the mask position with numpy : 0.007948875427246094 nb_pixel_total : 3034 time to create 1 rle with old method : 0.0034062862396240234 time for calcul the mask position with numpy : 0.007833242416381836 nb_pixel_total : 753 time to create 1 rle with old method : 0.0008788108825683594 time for calcul the mask position with numpy : 0.00790715217590332 nb_pixel_total : 173 time to create 1 rle with old method : 0.00019431114196777344 time for calcul the mask position with numpy : 0.008055686950683594 nb_pixel_total : 163 time to create 1 rle with old method : 0.00018644332885742188 time for calcul the mask position with numpy : 0.00786280632019043 nb_pixel_total : 237 time to create 1 rle with old method : 0.0002720355987548828 time for calcul the mask position with numpy : 0.008026838302612305 nb_pixel_total : 2386 time to create 1 rle with old method : 0.002859830856323242 time for calcul the mask position with numpy : 0.00792384147644043 nb_pixel_total : 1746 time to create 1 rle with old method : 0.0019626617431640625 time for calcul the mask position with numpy : 0.007624626159667969 nb_pixel_total : 987 time to create 1 rle with old method : 0.0011601448059082031 time for calcul the mask position with numpy : 0.008211374282836914 nb_pixel_total : 273 time to create 1 rle with old method : 0.0002989768981933594 time for calcul the mask position with numpy : 0.00794363021850586 nb_pixel_total : 276 time to create 1 rle with old method : 0.00033783912658691406 time for calcul the mask position with numpy : 0.008599042892456055 nb_pixel_total : 384 time to create 1 rle with old method : 0.00045680999755859375 time for calcul the mask position with numpy : 0.00811910629272461 nb_pixel_total : 4180 time to create 1 rle with old method : 0.0044574737548828125 time for calcul the mask position with numpy : 0.008019685745239258 nb_pixel_total : 21 time to create 1 rle with old method : 3.337860107421875e-05 time for calcul the mask position with numpy : 0.00811910629272461 nb_pixel_total : 8 time to create 1 rle with old method : 2.5987625122070312e-05 time for calcul the mask position with numpy : 0.008386373519897461 nb_pixel_total : 18 time to create 1 rle with old method : 3.337860107421875e-05 time for calcul the mask position with numpy : 0.008119821548461914 nb_pixel_total : 249 time to create 1 rle with old method : 0.00026154518127441406 time for calcul the mask position with numpy : 0.008143186569213867 nb_pixel_total : 237 time to create 1 rle with old method : 0.0002703666687011719 time for calcul the mask position with numpy : 0.008186578750610352 nb_pixel_total : 640 time to create 1 rle with old method : 0.0007128715515136719 time for calcul the mask position with numpy : 0.008369922637939453 nb_pixel_total : 313 time to create 1 rle with old method : 0.00036025047302246094 time for calcul the mask position with numpy : 0.007928609848022461 nb_pixel_total : 224 time to create 1 rle with old method : 0.00024175643920898438 time for calcul the mask position with numpy : 0.008020401000976562 nb_pixel_total : 500 time to create 1 rle with old method : 0.0005061626434326172 time for calcul the mask position with numpy : 0.008221864700317383 nb_pixel_total : 22 time to create 1 rle with old method : 5.745887756347656e-05 create new chi : 1.362353801727295 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.014365196228027344 batch 1 Loaded 78 chid ids of type : 4230 Number RLEs to save : 8331 TO DO : save crop sub photo not yet done ! save time : 0.725898027420044 nb_obj : 81 nb_hashtags : 5 time to prepare the origin masks : 1.9027695655822754 time for calcul the mask position with numpy : 0.06545042991638184 nb_pixel_total : 1616868 time to create 1 rle with new method : 0.08211255073547363 time for calcul the mask position with numpy : 0.010408163070678711 nb_pixel_total : 74231 time to create 1 rle with old method : 0.07868742942810059 time for calcul the mask position with numpy : 0.010313987731933594 nb_pixel_total : 73 time to create 1 rle with old method : 0.00012755393981933594 time for calcul the mask position with numpy : 0.010409355163574219 nb_pixel_total : 144 time to create 1 rle with old method : 0.0001957416534423828 time for calcul the mask position with numpy : 0.010163068771362305 nb_pixel_total : 434 time to create 1 rle with old method : 0.0004980564117431641 time for calcul the mask position with numpy : 0.010094881057739258 nb_pixel_total : 1255 time to create 1 rle with old method : 0.0013964176177978516 time for calcul the mask position with numpy : 0.005998373031616211 nb_pixel_total : 847 time to create 1 rle with old method : 0.0009829998016357422 time for calcul the mask position with numpy : 0.0059659481048583984 nb_pixel_total : 46 time to create 1 rle with old method : 9.894371032714844e-05 time for calcul the mask position with numpy : 0.006197452545166016 nb_pixel_total : 34 time to create 1 rle with old method : 6.365776062011719e-05 time for calcul the mask position with numpy : 0.0059735774993896484 nb_pixel_total : 371 time to create 1 rle with old method : 0.0004260540008544922 time for calcul the mask position with numpy : 0.005915641784667969 nb_pixel_total : 1432 time to create 1 rle with old method : 0.0016202926635742188 time for calcul the mask position with numpy : 0.006137371063232422 nb_pixel_total : 305 time to create 1 rle with old method : 0.0004017353057861328 time for calcul the mask position with numpy : 0.0058269500732421875 nb_pixel_total : 1977 time to create 1 rle with old method : 0.0023136138916015625 time for calcul the mask position with numpy : 0.005815744400024414 nb_pixel_total : 1269 time to create 1 rle with old method : 0.0014584064483642578 time for calcul the mask position with numpy : 0.005799531936645508 nb_pixel_total : 222 time to create 1 rle with old method : 0.0002880096435546875 time for calcul the mask position with numpy : 0.005911111831665039 nb_pixel_total : 1560 time to create 1 rle with old method : 0.0019009113311767578 time for calcul the mask position with numpy : 0.006111860275268555 nb_pixel_total : 5517 time to create 1 rle with old method : 0.006165504455566406 time for calcul the mask position with numpy : 0.006045818328857422 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003478527069091797 time for calcul the mask position with numpy : 0.005899190902709961 nb_pixel_total : 8 time to create 1 rle with old method : 2.6941299438476562e-05 time for calcul the mask position with numpy : 0.00608372688293457 nb_pixel_total : 1 time to create 1 rle with old method : 2.2411346435546875e-05 time for calcul the mask position with numpy : 0.005772829055786133 nb_pixel_total : 109 time to create 1 rle with old method : 0.0001685619354248047 time for calcul the mask position with numpy : 0.005956172943115234 nb_pixel_total : 991 time to create 1 rle with old method : 0.0010645389556884766 time for calcul the mask position with numpy : 0.0058362483978271484 nb_pixel_total : 387 time to create 1 rle with old method : 0.00044846534729003906 time for calcul the mask position with numpy : 0.006001472473144531 nb_pixel_total : 814 time to create 1 rle with old method : 0.0009524822235107422 time for calcul the mask position with numpy : 0.005845546722412109 nb_pixel_total : 154 time to create 1 rle with old method : 0.00019097328186035156 time for calcul the mask position with numpy : 0.006110429763793945 nb_pixel_total : 856 time to create 1 rle with old method : 0.0009615421295166016 time for calcul the mask position with numpy : 0.0061457157135009766 nb_pixel_total : 119 time to create 1 rle with old method : 0.00015687942504882812 time for calcul the mask position with numpy : 0.0060577392578125 nb_pixel_total : 876 time to create 1 rle with old method : 0.0009946823120117188 time for calcul the mask position with numpy : 0.006317615509033203 nb_pixel_total : 40 time to create 1 rle with old method : 6.842613220214844e-05 time for calcul the mask position with numpy : 0.00605463981628418 nb_pixel_total : 463 time to create 1 rle with old method : 0.0004909038543701172 time for calcul the mask position with numpy : 0.006126880645751953 nb_pixel_total : 485 time to create 1 rle with old method : 0.0005705356597900391 time for calcul the mask position with numpy : 0.006240367889404297 nb_pixel_total : 1575 time to create 1 rle with old method : 0.0018458366394042969 time for calcul the mask position with numpy : 0.006237030029296875 nb_pixel_total : 2384 time to create 1 rle with old method : 0.00269317626953125 time for calcul the mask position with numpy : 0.006281137466430664 nb_pixel_total : 539 time to create 1 rle with old method : 0.0006220340728759766 time for calcul the mask position with numpy : 0.0072977542877197266 nb_pixel_total : 147986 time to create 1 rle with old method : 0.16521930694580078 time for calcul the mask position with numpy : 0.0061872005462646484 nb_pixel_total : 729 time to create 1 rle with old method : 0.0008137226104736328 time for calcul the mask position with numpy : 0.006324052810668945 nb_pixel_total : 215 time to create 1 rle with old method : 0.00026917457580566406 time for calcul the mask position with numpy : 0.006227970123291016 nb_pixel_total : 1383 time to create 1 rle with old method : 0.0015769004821777344 time for calcul the mask position with numpy : 0.006388187408447266 nb_pixel_total : 28 time to create 1 rle with old method : 6.151199340820312e-05 time for calcul the mask position with numpy : 0.0063190460205078125 nb_pixel_total : 348 time to create 1 rle with old method : 0.00040721893310546875 time for calcul the mask position with numpy : 0.0061702728271484375 nb_pixel_total : 10 time to create 1 rle with old method : 3.3855438232421875e-05 time for calcul the mask position with numpy : 0.006013154983520508 nb_pixel_total : 288 time to create 1 rle with old method : 0.0004024505615234375 time for calcul the mask position with numpy : 0.006131410598754883 nb_pixel_total : 653 time to create 1 rle with old method : 0.0007493495941162109 time for calcul the mask position with numpy : 0.006110668182373047 nb_pixel_total : 3883 time to create 1 rle with old method : 0.004281759262084961 time for calcul the mask position with numpy : 0.0063631534576416016 nb_pixel_total : 1716 time to create 1 rle with old method : 0.0025489330291748047 time for calcul the mask position with numpy : 0.006661653518676758 nb_pixel_total : 395 time to create 1 rle with old method : 0.0006699562072753906 time for calcul the mask position with numpy : 0.006079435348510742 nb_pixel_total : 1722 time to create 1 rle with old method : 0.0019767284393310547 time for calcul the mask position with numpy : 0.0060651302337646484 nb_pixel_total : 488 time to create 1 rle with old method : 0.0005705356597900391 time for calcul the mask position with numpy : 0.006104946136474609 nb_pixel_total : 1651 time to create 1 rle with old method : 0.0018537044525146484 time for calcul the mask position with numpy : 0.006215572357177734 nb_pixel_total : 652 time to create 1 rle with old method : 0.000759124755859375 time for calcul the mask position with numpy : 0.0061931610107421875 nb_pixel_total : 361 time to create 1 rle with old method : 0.0004200935363769531 time for calcul the mask position with numpy : 0.006091117858886719 nb_pixel_total : 2206 time to create 1 rle with old method : 0.0025186538696289062 time for calcul the mask position with numpy : 0.0060884952545166016 nb_pixel_total : 428 time to create 1 rle with old method : 0.0004947185516357422 time for calcul the mask position with numpy : 0.0061414241790771484 nb_pixel_total : 99 time to create 1 rle with old method : 0.00013208389282226562 time for calcul the mask position with numpy : 0.006567239761352539 nb_pixel_total : 105189 time to create 1 rle with old method : 0.11881613731384277 time for calcul the mask position with numpy : 0.006083011627197266 nb_pixel_total : 6793 time to create 1 rle with old method : 0.007569789886474609 time for calcul the mask position with numpy : 0.006094694137573242 nb_pixel_total : 22611 time to create 1 rle with old method : 0.0241851806640625 time for calcul the mask position with numpy : 0.006040811538696289 nb_pixel_total : 449 time to create 1 rle with old method : 0.0005254745483398438 time for calcul the mask position with numpy : 0.0060405731201171875 nb_pixel_total : 944 time to create 1 rle with old method : 0.0010755062103271484 time for calcul the mask position with numpy : 0.0060291290283203125 nb_pixel_total : 38558 time to create 1 rle with old method : 0.04130244255065918 time for calcul the mask position with numpy : 0.006337404251098633 nb_pixel_total : 3491 time to create 1 rle with old method : 0.0040705204010009766 time for calcul the mask position with numpy : 0.0059947967529296875 nb_pixel_total : 16 time to create 1 rle with old method : 4.7206878662109375e-05 time for calcul the mask position with numpy : 0.006046772003173828 nb_pixel_total : 627 time to create 1 rle with old method : 0.0007116794586181641 time for calcul the mask position with numpy : 0.0066301822662353516 nb_pixel_total : 180 time to create 1 rle with old method : 0.000274658203125 time for calcul the mask position with numpy : 0.006407737731933594 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002040863037109375 time for calcul the mask position with numpy : 0.006554365158081055 nb_pixel_total : 238 time to create 1 rle with old method : 0.00029015541076660156 time for calcul the mask position with numpy : 0.006553173065185547 nb_pixel_total : 2999 time to create 1 rle with old method : 0.003302335739135742 time for calcul the mask position with numpy : 0.0071980953216552734 nb_pixel_total : 36 time to create 1 rle with old method : 0.00010132789611816406 time for calcul the mask position with numpy : 0.006867647171020508 nb_pixel_total : 264 time to create 1 rle with old method : 0.0003650188446044922 time for calcul the mask position with numpy : 0.006327629089355469 nb_pixel_total : 1361 time to create 1 rle with old method : 0.001943349838256836 time for calcul the mask position with numpy : 0.007429838180541992 nb_pixel_total : 291 time to create 1 rle with old method : 0.0004417896270751953 time for calcul the mask position with numpy : 0.0076084136962890625 nb_pixel_total : 105 time to create 1 rle with old method : 0.0002570152282714844 time for calcul the mask position with numpy : 0.009489774703979492 nb_pixel_total : 291 time to create 1 rle with old method : 0.0004189014434814453 time for calcul the mask position with numpy : 0.007710456848144531 nb_pixel_total : 283 time to create 1 rle with old method : 0.0004153251647949219 time for calcul the mask position with numpy : 0.007701396942138672 nb_pixel_total : 20 time to create 1 rle with old method : 4.839897155761719e-05 time for calcul the mask position with numpy : 0.007637739181518555 nb_pixel_total : 5588 time to create 1 rle with old method : 0.0077512264251708984 time for calcul the mask position with numpy : 0.007820844650268555 nb_pixel_total : 7 time to create 1 rle with old method : 3.4809112548828125e-05 time for calcul the mask position with numpy : 0.0077702999114990234 nb_pixel_total : 214 time to create 1 rle with old method : 0.0005207061767578125 time for calcul the mask position with numpy : 0.009507894515991211 nb_pixel_total : 74 time to create 1 rle with old method : 0.0002353191375732422 time for calcul the mask position with numpy : 0.011313438415527344 nb_pixel_total : 184 time to create 1 rle with old method : 0.00033473968505859375 time for calcul the mask position with numpy : 0.010815620422363281 nb_pixel_total : 550 time to create 1 rle with old method : 0.0008497238159179688 time for calcul the mask position with numpy : 0.012507200241088867 nb_pixel_total : 212 time to create 1 rle with old method : 0.0003802776336669922 create new chi : 1.2231860160827637 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0014984607696533203 batch 1 Loaded 82 chid ids of type : 4230 Number RLEs to save : 9534 TO DO : save crop sub photo not yet done ! save time : 0.7950811386108398 nb_obj : 75 nb_hashtags : 6 time to prepare the origin masks : 1.3358514308929443 time for calcul the mask position with numpy : 0.019168853759765625 nb_pixel_total : 1770603 time to create 1 rle with new method : 0.051602840423583984 time for calcul the mask position with numpy : 0.0062408447265625 nb_pixel_total : 62570 time to create 1 rle with old method : 0.0648198127746582 time for calcul the mask position with numpy : 0.005880832672119141 nb_pixel_total : 318 time to create 1 rle with old method : 0.00041174888610839844 time for calcul the mask position with numpy : 0.005867481231689453 nb_pixel_total : 343 time to create 1 rle with old method : 0.0003972053527832031 time for calcul the mask position with numpy : 0.005910158157348633 nb_pixel_total : 458 time to create 1 rle with old method : 0.0005271434783935547 time for calcul the mask position with numpy : 0.005849599838256836 nb_pixel_total : 2059 time to create 1 rle with old method : 0.002281665802001953 time for calcul the mask position with numpy : 0.006117343902587891 nb_pixel_total : 896 time to create 1 rle with old method : 0.0010030269622802734 time for calcul the mask position with numpy : 0.006330013275146484 nb_pixel_total : 72 time to create 1 rle with old method : 0.00012493133544921875 time for calcul the mask position with numpy : 0.006242275238037109 nb_pixel_total : 111 time to create 1 rle with old method : 0.00017881393432617188 time for calcul the mask position with numpy : 0.010524749755859375 nb_pixel_total : 733 time to create 1 rle with old method : 0.0008568763732910156 time for calcul the mask position with numpy : 0.010507345199584961 nb_pixel_total : 803 time to create 1 rle with old method : 0.0009260177612304688 time for calcul the mask position with numpy : 0.010387420654296875 nb_pixel_total : 2267 time to create 1 rle with old method : 0.0024862289428710938 time for calcul the mask position with numpy : 0.011147737503051758 nb_pixel_total : 169 time to create 1 rle with old method : 0.0002529621124267578 time for calcul the mask position with numpy : 0.010572671890258789 nb_pixel_total : 6286 time to create 1 rle with old method : 0.0070683956146240234 time for calcul the mask position with numpy : 0.010679244995117188 nb_pixel_total : 6464 time to create 1 rle with old method : 0.0071260929107666016 time for calcul the mask position with numpy : 0.009940147399902344 nb_pixel_total : 250 time to create 1 rle with old method : 0.0002961158752441406 time for calcul the mask position with numpy : 0.009922504425048828 nb_pixel_total : 1510 time to create 1 rle with old method : 0.0015478134155273438 time for calcul the mask position with numpy : 0.00981283187866211 nb_pixel_total : 142 time to create 1 rle with old method : 0.00016307830810546875 time for calcul the mask position with numpy : 0.009750843048095703 nb_pixel_total : 142 time to create 1 rle with old method : 0.0001747608184814453 time for calcul the mask position with numpy : 0.009708642959594727 nb_pixel_total : 645 time to create 1 rle with old method : 0.0007238388061523438 time for calcul the mask position with numpy : 0.009737968444824219 nb_pixel_total : 389 time to create 1 rle with old method : 0.00045180320739746094 time for calcul the mask position with numpy : 0.009758949279785156 nb_pixel_total : 466 time to create 1 rle with old method : 0.0005490779876708984 time for calcul the mask position with numpy : 0.009767293930053711 nb_pixel_total : 525 time to create 1 rle with old method : 0.0006117820739746094 time for calcul the mask position with numpy : 0.0059354305267333984 nb_pixel_total : 668 time to create 1 rle with old method : 0.0007004737854003906 time for calcul the mask position with numpy : 0.005749702453613281 nb_pixel_total : 781 time to create 1 rle with old method : 0.0008435249328613281 time for calcul the mask position with numpy : 0.005694389343261719 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002295970916748047 time for calcul the mask position with numpy : 0.005846261978149414 nb_pixel_total : 1272 time to create 1 rle with old method : 0.0013823509216308594 time for calcul the mask position with numpy : 0.006284475326538086 nb_pixel_total : 122 time to create 1 rle with old method : 0.00017452239990234375 time for calcul the mask position with numpy : 0.006050586700439453 nb_pixel_total : 394 time to create 1 rle with old method : 0.00045371055603027344 time for calcul the mask position with numpy : 0.005869865417480469 nb_pixel_total : 289 time to create 1 rle with old method : 0.0003769397735595703 time for calcul the mask position with numpy : 0.00604248046875 nb_pixel_total : 5 time to create 1 rle with old method : 3.7670135498046875e-05 time for calcul the mask position with numpy : 0.005998849868774414 nb_pixel_total : 880 time to create 1 rle with old method : 0.0009982585906982422 time for calcul the mask position with numpy : 0.0059320926666259766 nb_pixel_total : 1233 time to create 1 rle with old method : 0.0013701915740966797 time for calcul the mask position with numpy : 0.0057849884033203125 nb_pixel_total : 516 time to create 1 rle with old method : 0.0005476474761962891 time for calcul the mask position with numpy : 0.005799055099487305 nb_pixel_total : 3895 time to create 1 rle with old method : 0.0040323734283447266 time for calcul the mask position with numpy : 0.006096839904785156 nb_pixel_total : 1863 time to create 1 rle with old method : 0.002025127410888672 time for calcul the mask position with numpy : 0.00596308708190918 nb_pixel_total : 552 time to create 1 rle with old method : 0.0006577968597412109 time for calcul the mask position with numpy : 0.006022930145263672 nb_pixel_total : 1559 time to create 1 rle with old method : 0.0018091201782226562 time for calcul the mask position with numpy : 0.005951881408691406 nb_pixel_total : 562 time to create 1 rle with old method : 0.0006642341613769531 time for calcul the mask position with numpy : 0.005933523178100586 nb_pixel_total : 501 time to create 1 rle with old method : 0.0005350112915039062 time for calcul the mask position with numpy : 0.0060923099517822266 nb_pixel_total : 1633 time to create 1 rle with old method : 0.0020737648010253906 time for calcul the mask position with numpy : 0.005808591842651367 nb_pixel_total : 875 time to create 1 rle with old method : 0.0009906291961669922 time for calcul the mask position with numpy : 0.0061380863189697266 nb_pixel_total : 520 time to create 1 rle with old method : 0.0006082057952880859 time for calcul the mask position with numpy : 0.006204366683959961 nb_pixel_total : 2346 time to create 1 rle with old method : 0.002605438232421875 time for calcul the mask position with numpy : 0.006301403045654297 nb_pixel_total : 1041 time to create 1 rle with old method : 0.0011975765228271484 time for calcul the mask position with numpy : 0.006114006042480469 nb_pixel_total : 433 time to create 1 rle with old method : 0.0005238056182861328 time for calcul the mask position with numpy : 0.0061321258544921875 nb_pixel_total : 108 time to create 1 rle with old method : 0.0001404285430908203 time for calcul the mask position with numpy : 0.006185054779052734 nb_pixel_total : 447 time to create 1 rle with old method : 0.0005242824554443359 time for calcul the mask position with numpy : 0.007546186447143555 nb_pixel_total : 104402 time to create 1 rle with old method : 0.11946964263916016 time for calcul the mask position with numpy : 0.006191253662109375 nb_pixel_total : 53 time to create 1 rle with old method : 7.772445678710938e-05 time for calcul the mask position with numpy : 0.005937099456787109 nb_pixel_total : 16 time to create 1 rle with old method : 3.886222839355469e-05 time for calcul the mask position with numpy : 0.005954265594482422 nb_pixel_total : 8314 time to create 1 rle with old method : 0.009006261825561523 time for calcul the mask position with numpy : 0.006145000457763672 nb_pixel_total : 24625 time to create 1 rle with old method : 0.02594137191772461 time for calcul the mask position with numpy : 0.006003379821777344 nb_pixel_total : 460 time to create 1 rle with old method : 0.00048828125 time for calcul the mask position with numpy : 0.005906820297241211 nb_pixel_total : 966 time to create 1 rle with old method : 0.0011174678802490234 time for calcul the mask position with numpy : 0.005963802337646484 nb_pixel_total : 39539 time to create 1 rle with old method : 0.04302024841308594 time for calcul the mask position with numpy : 0.006108283996582031 nb_pixel_total : 3927 time to create 1 rle with old method : 0.004404306411743164 time for calcul the mask position with numpy : 0.006069660186767578 nb_pixel_total : 698 time to create 1 rle with old method : 0.0007903575897216797 time for calcul the mask position with numpy : 0.006073474884033203 nb_pixel_total : 184 time to create 1 rle with old method : 0.0002231597900390625 time for calcul the mask position with numpy : 0.006169319152832031 nb_pixel_total : 173 time to create 1 rle with old method : 0.0002269744873046875 time for calcul the mask position with numpy : 0.006063222885131836 nb_pixel_total : 4213 time to create 1 rle with old method : 0.0046100616455078125 time for calcul the mask position with numpy : 0.006067037582397461 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003075599670410156 time for calcul the mask position with numpy : 0.006150960922241211 nb_pixel_total : 480 time to create 1 rle with old method : 0.0005605220794677734 time for calcul the mask position with numpy : 0.006042957305908203 nb_pixel_total : 1302 time to create 1 rle with old method : 0.001474142074584961 time for calcul the mask position with numpy : 0.006047964096069336 nb_pixel_total : 64 time to create 1 rle with old method : 0.000102996826171875 time for calcul the mask position with numpy : 0.0059278011322021484 nb_pixel_total : 836 time to create 1 rle with old method : 0.0009474754333496094 time for calcul the mask position with numpy : 0.006013154983520508 nb_pixel_total : 275 time to create 1 rle with old method : 0.0003287792205810547 time for calcul the mask position with numpy : 0.006031513214111328 nb_pixel_total : 49 time to create 1 rle with old method : 7.772445678710938e-05 time for calcul the mask position with numpy : 0.006020784378051758 nb_pixel_total : 280 time to create 1 rle with old method : 0.00033354759216308594 time for calcul the mask position with numpy : 0.006032228469848633 nb_pixel_total : 278 time to create 1 rle with old method : 0.0003287792205810547 time for calcul the mask position with numpy : 0.0059468746185302734 nb_pixel_total : 4 time to create 1 rle with old method : 3.4809112548828125e-05 time for calcul the mask position with numpy : 0.006031513214111328 nb_pixel_total : 15 time to create 1 rle with old method : 3.838539123535156e-05 time for calcul the mask position with numpy : 0.005912303924560547 nb_pixel_total : 224 time to create 1 rle with old method : 0.0002846717834472656 time for calcul the mask position with numpy : 0.00601506233215332 nb_pixel_total : 185 time to create 1 rle with old method : 0.00022745132446289062 time for calcul the mask position with numpy : 0.0060329437255859375 nb_pixel_total : 667 time to create 1 rle with old method : 0.000766754150390625 time for calcul the mask position with numpy : 0.0059909820556640625 nb_pixel_total : 208 time to create 1 rle with old method : 0.00027871131896972656 create new chi : 0.9182398319244385 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0011074542999267578 batch 1 Loaded 76 chid ids of type : 4230 Number RLEs to save : 8775 TO DO : save crop sub photo not yet done ! save time : 0.9550271034240723 map_output_result : {1340529049: (0.0, 'Should be the crop_list due to order', 0.0), 1340529032: (0.0, 'Should be the crop_list due to order', 0.0), 1340529031: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1340529049, 1340529032, 1340529031] Looping around the photos to save general results len do output : 3 /1340529049.Didn't retrieve data . /1340529032.Didn't retrieve data . /1340529031.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529049', None, None, None, None, None, '2627694') ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529032', None, None, None, None, None, '2627694') ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529031', None, None, None, None, None, '2627694') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.0893709659576416 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.774730205535889 time spend to save output : 0.0896916389465332 total time spend for step 4 : 10.864421844482422 step5:crop_condition Mon Mar 3 04:21:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 3 ! batch 1 Loaded 236 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 79 About to insert : list_path_to_insert length 79 new photo from crops ! About to upload 79 photos upload in portfolio : 4869462 init cache_photo without model_param we have 79 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740972072_136840 we have uploaded 79 photos in the portfolio 4869462 time of upload the photos Elapsed time : 22.885793924331665 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 4869462 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740972095_136840 we have uploaded 26 photos in the portfolio 4869462 time of upload the photos Elapsed time : 7.46321702003479 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 4869462 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740972103_136840 we have uploaded 5 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.5358226299285889 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 49 About to insert : list_path_to_insert length 49 new photo from crops ! About to upload 49 photos upload in portfolio : 4869462 init cache_photo without model_param we have 49 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740972105_136840 we have uploaded 49 photos in the portfolio 4869462 time of upload the photos Elapsed time : 17.108203649520874 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1340529049, 1340529032, 1340529031] Looping around the photos to save general results len do output : 159 /1340574104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340574389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529049', None, None, None, None, None, '2627694') ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529032', None, None, None, None, None, '2627694') ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529031', None, None, None, None, None, '2627694') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 480 time used for this insertion : 1.4851281642913818 save_final save missing photos in datou_result : time spend for datou_step_exec : 52.522749185562134 time spend to save output : 1.4920234680175781 total time spend for step 5 : 54.01477265357971 step6:thcl Mon Mar 3 04:22:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.008890628814697266 time to convert the images to numpy array : 0.049886465072631836 time to import caffe and check if the image exist : 0.011355876922607422 time to convert the images to numpy array : 0.05348920822143555 time to import caffe and check if the image exist : 0.018158435821533203 time to convert the images to numpy array : 0.047919511795043945 time to import caffe and check if the image exist : 0.014340400695800781 time to convert the images to numpy array : 0.05085277557373047 time to import caffe and check if the image exist : 0.013201236724853516 time to convert the images to numpy array : 0.053748130798339844 time to import caffe and check if the image exist : 0.01349186897277832 time to convert the images to numpy array : 0.05563783645629883 time to import caffe and check if the image exist : 0.013705730438232422 time to convert the images to numpy array : 0.055438995361328125 time to import caffe and check if the image exist : 0.015658855438232422 time to convert the images to numpy array : 0.05507087707519531 time to import caffe and check if the image exist : 0.02455592155456543 time to convert the images to numpy array : 0.047577857971191406 time to import caffe and check if the image exist : 0.014322280883789062 time to convert the images to numpy array : 0.05926799774169922 total time to convert the images to numpy array : 0.2990689277648926 list photo_ids error: [] list photo_ids correct : [1340574268, 1340574270, 1340574272, 1340574273, 1340574274, 1340574275, 1340574277, 1340574280, 1340574282, 1340574284, 1340574286, 1340574288, 1340574289, 1340574290, 1340574291, 1340574292, 1340574104, 1340574105, 1340574106, 1340574107, 1340574108, 1340574109, 1340574110, 1340574111, 1340574112, 1340574113, 1340574115, 1340574117, 1340574119, 1340574121, 1340574123, 1340574125, 1340574159, 1340574161, 1340574163, 1340574165, 1340574167, 1340574169, 1340574171, 1340574173, 1340574175, 1340574177, 1340574179, 1340574181, 1340574183, 1340574185, 1340574187, 1340574189, 1340574293, 1340574294, 1340574295, 1340574296, 1340574297, 1340574298, 1340574299, 1340574300, 1340574301, 1340574302, 1340574303, 1340574304, 1340574305, 1340574306, 1340574341, 1340574342, 1340574375, 1340574376, 1340574377, 1340574378, 1340574379, 1340574380, 1340574381, 1340574382, 1340574383, 1340574384, 1340574385, 1340574386, 1340574387, 1340574388, 1340574389, 1340574191, 1340574193, 1340574195, 1340574197, 1340574199, 1340574201, 1340574203, 1340574205, 1340574207, 1340574209, 1340574211, 1340574213, 1340574215, 1340574217, 1340574219, 1340574221, 1340574223, 1340574225, 1340574227, 1340574229, 1340574231, 1340574233, 1340574234, 1340574235, 1340574236, 1340574237, 1340574238, 1340574239, 1340574240, 1340574241, 1340574242, 1340574267, 1340574127, 1340574129, 1340574131, 1340574133, 1340574135, 1340574137, 1340574139, 1340574141, 1340574143, 1340574145, 1340574147, 1340574149, 1340574151, 1340574153, 1340574155, 1340574157, 1340574343, 1340574344, 1340574345, 1340574346, 1340574347, 1340574348, 1340574349, 1340574350, 1340574351, 1340574352, 1340574353, 1340574354, 1340574355, 1340574356, 1340574357, 1340574358, 1340574359, 1340574360, 1340574361, 1340574362, 1340574363, 1340574364, 1340574365, 1340574366, 1340574367, 1340574368, 1340574369, 1340574370, 1340574371, 1340574372, 1340574373, 1340574374] number of photos to traite : 159 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10593 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10374 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 0.7850930690765381 time used to do the prediction : 0.6164422035217285 save descriptor for thcl : 3237 time to traite the descriptors : 0.9067416191101074 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1340574268 To insert : 1340574270 To insert : 1340574272 To insert : 1340574273 To insert : 1340574274 To insert : 1340574275 To insert : 1340574277 To insert : 1340574280 To insert : 1340574282 To insert : 1340574284 To insert : 1340574286 To insert : 1340574288 To insert : 1340574289 To insert : 1340574290 To insert : 1340574291 To insert : 1340574292 To insert : 1340574104 To insert : 1340574105 To insert : 1340574106 To insert : 1340574107 To insert : 1340574108 To insert : 1340574109 To insert : 1340574110 To insert : 1340574111 To insert : 1340574112 To insert : 1340574113 To insert : 1340574115 To insert : 1340574117 To insert : 1340574119 To insert : 1340574121 To insert : 1340574123 To insert : 1340574125 To insert : 1340574159 To insert : 1340574161 To insert : 1340574163 To insert : 1340574165 To insert : 1340574167 To insert : 1340574169 To insert : 1340574171 To insert : 1340574173 To insert : 1340574175 To insert : 1340574177 To insert : 1340574179 To insert : 1340574181 To insert : 1340574183 To insert : 1340574185 To insert : 1340574187 To insert : 1340574189 To insert : 1340574293 To insert : 1340574294 To insert : 1340574295 To insert : 1340574296 To insert : 1340574297 To insert : 1340574298 To insert : 1340574299 To insert : 1340574300 To insert : 1340574301 To insert : 1340574302 To insert : 1340574303 To insert : 1340574304 To insert : 1340574305 To insert : 1340574306 To insert : 1340574341 To insert : 1340574342 To insert : 1340574375 To insert : 1340574376 To insert : 1340574377 To insert : 1340574378 To insert : 1340574379 To insert : 1340574380 To insert : 1340574381 To insert : 1340574382 To insert : 1340574383 To insert : 1340574384 To insert : 1340574385 To insert : 1340574386 To insert : 1340574387 To insert : 1340574388 To insert : 1340574389 To insert : 1340574191 To insert : 1340574193 To insert : 1340574195 To insert : 1340574197 To insert : 1340574199 To insert : 1340574201 To insert : 1340574203 To insert : 1340574205 To insert : 1340574207 To insert : 1340574209 To insert : 1340574211 To insert : 1340574213 To insert : 1340574215 To insert : 1340574217 To insert : 1340574219 To insert : 1340574221 To insert : 1340574223 To insert : 1340574225 To insert : 1340574227 To insert : 1340574229 To insert : 1340574231 To insert : 1340574233 To insert : 1340574234 To insert : 1340574235 To insert : 1340574236 To insert : 1340574237 To insert : 1340574238 To insert : 1340574239 To insert : 1340574240 To insert : 1340574241 To insert : 1340574242 To insert : 1340574267 To insert : 1340574127 To insert : 1340574129 To insert : 1340574131 To insert : 1340574133 To insert : 1340574135 To insert : 1340574137 To insert : 1340574139 To insert : 1340574141 To insert : 1340574143 To insert : 1340574145 To insert : 1340574147 To insert : 1340574149 To insert : 1340574151 To insert : 1340574153 To insert : 1340574155 To insert : 1340574157 To insert : 1340574343 To insert : 1340574344 To insert : 1340574345 To insert : 1340574346 To insert : 1340574347 To insert : 1340574348 To insert : 1340574349 To insert : 1340574350 To insert : 1340574351 To insert : 1340574352 To insert : 1340574353 To insert : 1340574354 To insert : 1340574355 To insert : 1340574356 To insert : 1340574357 To insert : 1340574358 To insert : 1340574359 To insert : 1340574360 To insert : 1340574361 To insert : 1340574362 To insert : 1340574363 To insert : 1340574364 To insert : 1340574365 To insert : 1340574366 To insert : 1340574367 To insert : 1340574368 To insert : 1340574369 To insert : 1340574370 To insert : 1340574371 To insert : 1340574372 To insert : 1340574373 To insert : 1340574374 time to insert the descriptors : 32.12385034561157 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 249 time used for this insertion : 0.02474188804626465 save missing photos in datou_result : time spend for datou_step_exec : 38.51710271835327 time spend to save output : 0.0799713134765625 total time spend for step 6 : 38.597074031829834 step7:ventilate_hashtags_in_portfolio Mon Mar 3 04:22:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20957633 get user id for portfolio 20957633 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957633 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','pet_fonce','mal_croppe','papier','PET_clair','Tetrapak','PET_fonce','pet_clair','PEHD','Papier','carton','refus','pehd','Carton','environnement','metal','flou','Film_plastique')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957633 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','pet_fonce','mal_croppe','papier','PET_clair','Tetrapak','PET_fonce','pet_clair','PEHD','Papier','carton','refus','pehd','Carton','environnement','metal','flou','Film_plastique')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957633 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','pet_fonce','mal_croppe','papier','PET_clair','Tetrapak','PET_fonce','pet_clair','PEHD','Papier','carton','refus','pehd','Carton','environnement','metal','flou','Film_plastique')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957633 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','pet_fonce','mal_croppe','papier','PET_clair','Tetrapak','PET_fonce','pet_clair','PEHD','Papier','carton','refus','pehd','Carton','environnement','metal','flou','Film_plastique')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20959985,20959991,20959987,20959994,20959992,20959990,20959997,20959998,20959996,20959999,20960000,20960001,20960002?tags=autre,pet_fonce,mal_croppe,papier,pet_clair,tetrapak,pehd,carton,refus,environnement,metal,flou,film_plastique&datou_id_consolidate=4235&port_consolidate=20957633 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1340529049, 1340529032, 1340529031] Looping around the photos to save general results len do output : 1 /20957633. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529049', None, None, None, None, None, '2627694') ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529032', None, None, None, None, None, '2627694') ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529031', None, None, None, None, None, '2627694') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.01395416259765625 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.694525718688965 time spend to save output : 0.014219999313354492 total time spend for step 7 : 3.7087457180023193 step8:final Mon Mar 3 04:22:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1340529049: ('0.24977640382063548',), 1340529032: ('0.24977640382063548',), 1340529031: ('0.24977640382063548',)} new output for save of step final : {1340529049: ('0.24977640382063548',), 1340529032: ('0.24977640382063548',), 1340529031: ('0.24977640382063548',)} [1340529049, 1340529032, 1340529031] Looping around the photos to save general results len do output : 3 /1340529049.Didn't retrieve data . /1340529032.Didn't retrieve data . /1340529031.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529049', None, None, None, None, None, '2627694') ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529032', None, None, None, None, None, '2627694') ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529031', None, None, None, None, None, '2627694') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014430046081542969 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11586189270019531 time spend to save output : 0.014721155166625977 total time spend for step 8 : 0.1305830478668213 step9:velours_tree Mon Mar 3 04:22:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20959985,20959991,20959987,20959994,20959992,20959990,20959997,20959998,20959996,20959999,20960000,20960001,20960002 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20959985 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20959991 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20959987 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20959994 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20959992 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20959990 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20959997 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20959998 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20959996 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20959999 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20960000 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20960001 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20960002 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 159 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [2 2 2 2 2 2 4 0 4 4 4 0 5 4 0 0 0 0 5 1 2 0 4 4 3 1 2 2 2 2 2 2 2 2 4 0 4 2 4 4 0 5 4 0 0 0 0 5 2 0 4 4 2 2 2 4 2 2 2 2 4 4 0 0 0 4 4 4 0 5 4 0 0 0 0 5 2 4 4 1 3 1 2 4 5 2 3 2 2 4 0 5 1 1 3 3 3 2 4 0 4 5 4 1 4 4 0 0 4 0 3 3 0 4 2 3 1 4 2 0 0 0 1 0 1 1 1 1 3 1 2 2 2 0 4 4 0 1 0 3 1 0 1 1 1 3 3 1 2 2 4 0 0 0 0 3 1 1 1] Elapsed time: 0.022219181060791016 graph_id used : 81124 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20959985,20959991,20959987,20959994,20959992,20959990,20959997,20959998,20959996,20959999,20960000,20960001,20960002?tags=autre,pet_fonce,mal_croppe,papier,pet_clair,tetrapak,pehd,carton,refus,environnement,metal,flou,film_plastique&datou_id_consolidate=4235&port_consolidate=20957633&tree_id=81124 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1340529049, 1340529032, 1340529031] Looping around the photos to save general results len do output : 1 /20957633Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529049', None, None, None, None, None, '2627694') ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529032', None, None, None, None, None, '2627694') ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529031', None, None, None, None, None, '2627694') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.013576030731201172 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.334141492843628 time spend to save output : 0.013831615447998047 total time spend for step 9 : 15.347973108291626 step10:send_mail_cod Mon Mar 3 04:23:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20957633_03-03-2025_04_23_01.pdf 20959967 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209599671740972181 20959973 imagette209599731740972182 20959969 imagette209599691740972182 20959976 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209599761740972182 20959974 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209599741740972184 20959972 imagette209599721740972184 20959979 imagette209599791740972184 20959980 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209599801740972184 20959978 imagette209599781740972185 20959982 imagette209599821740972185 20959983 imagette209599831740972185 20959984 imagette209599841740972185 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20957633 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20959985,20959991,20959987,20959994,20959992,20959990,20959997,20959998,20959996,20959999,20960000,20960001,20960002?tags=autre,pet_fonce,mal_croppe,papier,pet_clair,tetrapak,pehd,carton,refus,environnement,metal,flou,film_plastique&datou_id_consolidate=4235&port_consolidate=20957633&tree_id=81124 your option no_mail is active, we will not send the real mail to your client args[1340529049] : ((1340529049, -7.48735850264301, 492609224), (1340529049, -0.44160153225350496, 496442774), '0.24977640382063548') We are sending mail with results at cod@fotonower.com args[1340529032] : ((1340529032, -7.499733103714181, 492609224), (1340529032, -0.4410263020729854, 496442774), '0.24977640382063548') We are sending mail with results at cod@fotonower.com args[1340529031] : ((1340529031, -7.500327883717034, 492609224), (1340529031, -0.4429526647255164, 496442774), '0.24977640382063548') We are sending mail with results at cod@fotonower.com refus_total : 0.24977640382063548 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20957633 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957633_03-03-2025_04_23_01.pdf results_Qualipapia_P20957633_03-03-2025_04_23_01.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957633_03-03-2025_04_23_01.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20957633','results_Qualipapia_P20957633_03-03-2025_04_23_01.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957633_03-03-2025_04_23_01.pdf','pdf','','0.15','0.24977640382063548') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1340529049, 1340529032, 1340529031] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529049', None, None, None, None, None, '2627694') ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529032', None, None, None, None, None, '2627694') ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529031', None, None, None, None, None, '2627694') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.013788223266601562 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.228076219558716 time spend to save output : 0.01393580436706543 total time spend for step 10 : 4.242012023925781 step11:split_time_score Mon Mar 3 04:23:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 3),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 02032025 20957633 Nombre de photos uploadées : 3 / 23040 (0%) 02032025 20957633 Nombre de photos taguées (types de déchets): 3 / 3 (100%) 02032025 20957633 Nombre de photos taguées (volume) : 0 / 3 (0%) elapsed_time : load_data_split_time_score 2.6226043701171875e-06 elapsed_time : order_list_meta_photo_and_scores 6.9141387939453125e-06 ??? elapsed_time : fill_and_build_computed_from_old_data 0.00023698806762695312 elapsed_time : insert_dashboard_record_day_entry 0.023993492126464844 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.2252703825492472 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957601_03-03-2025_02_27_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957601 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957601 AND mptpi.`type`=4230 To do Qualite : 0.15463371235631973 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957602_03-03-2025_02_32_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957602 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957602 AND mptpi.`type`=4230 To do Qualite : 0.18805833440296038 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957603_03-03-2025_02_37_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957603 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957603 AND mptpi.`type`=4230 To do Qualite : 0.20950770155173523 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957604_03-03-2025_02_44_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957604 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957604 AND mptpi.`type`=4230 To do Qualite : 0.19618168390724053 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957605_03-03-2025_02_48_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957605 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957605 AND mptpi.`type`=4230 To do Qualite : 0.16472733253190136 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957606_03-03-2025_02_53_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957606 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957606 AND mptpi.`type`=4230 To do Qualite : 0.20651461983421518 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957607_03-03-2025_02_58_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957607 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957607 AND mptpi.`type`=4230 To do Qualite : 0.17120053479558975 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957608_03-03-2025_03_02_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957608 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957608 AND mptpi.`type`=4230 To do Qualite : 0.2278850267803086 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957609_03-03-2025_03_08_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957609 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957609 AND mptpi.`type`=4230 To do Qualite : 0.16480025188145667 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957610_03-03-2025_03_12_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957610 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957610 AND mptpi.`type`=4230 To do Qualite : 0.18204000842143941 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957611_03-03-2025_03_17_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957611 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957611 AND mptpi.`type`=4230 To do Qualite : 0.19495974599956606 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957612_03-03-2025_03_32_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957612 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957612 AND mptpi.`type`=4230 To do Qualite : 0.18668138736816026 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957613_03-03-2025_03_27_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957613 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957613 AND mptpi.`type`=4230 To do Qualite : 0.17836824714157726 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957614_03-03-2025_03_32_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957614 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957614 AND mptpi.`type`=4230 To do Qualite : 0.09344995497650531 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957615_03-03-2025_03_36_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957615 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957615 AND mptpi.`type`=4230 To do Qualite : 0.1908463273134469 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957616_03-03-2025_03_44_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957616 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957616 AND mptpi.`type`=4230 To do Qualite : 0.2386556461765833 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957617_03-03-2025_03_47_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957617 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957617 AND mptpi.`type`=4230 To do Qualite : 0.18306948082620506 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957618_03-03-2025_03_53_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957618 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957618 AND mptpi.`type`=4230 To do Qualite : 0.16454103991472227 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957619_03-03-2025_03_57_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957619 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957619 AND mptpi.`type`=4230 To do Qualite : 0.2077104342719261 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957620_03-03-2025_04_02_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957620 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957620 AND mptpi.`type`=4230 To do Qualite : 0.22227322024771315 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957621_03-03-2025_04_17_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957621 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957621 AND mptpi.`type`=4230 To do Qualite : 0.2333266664227684 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957622_03-03-2025_04_15_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957622 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957622 AND mptpi.`type`=4230 To do Qualite : 0.20406723778474073 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957623_03-03-2025_04_17_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957623 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957623 AND mptpi.`type`=4230 To do Qualite : 0.24690543243124255 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957624_03-03-2025_04_22_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957624 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957624 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957625 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957626 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957627 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957628 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957629 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957630 order by id desc limit 1 Qualite : 0.18555471543654084 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957631_03-03-2025_04_17_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957631 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957631 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957632 order by id desc limit 1 Qualite : 0.24977640382063548 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957633_03-03-2025_04_23_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957633 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957633 AND mptpi.`type`=4230 To do Qualite : 0.20411391494007197 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957634_03-03-2025_03_32_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957634 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957634 AND mptpi.`type`=4230 To do Qualite : 0.19942088408373115 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957635_03-03-2025_03_46_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957635 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957635 AND mptpi.`type`=4230 To do Qualite : 0.2158797684192484 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957636_03-03-2025_03_18_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957636 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957636 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957637 order by id desc limit 1 Qualite : 0.19786257791844544 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957638_03-03-2025_03_29_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957638 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957638 AND mptpi.`type`=4230 To do Qualite : 0.2127714770099192 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957639_03-03-2025_02_47_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957639 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957639 AND mptpi.`type`=4230 To do Qualite : 0.20227181433776772 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957640_03-03-2025_02_52_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957640 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957640 AND mptpi.`type`=4230 To do Qualite : 0.19462588382958715 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957641_03-03-2025_02_40_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957641 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957641 AND mptpi.`type`=4230 To do Qualite : 0.16844320161035617 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957642_03-03-2025_01_57_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957642 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957642 AND mptpi.`type`=4230 To do Qualite : 0.192882259433865 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957643_03-03-2025_01_50_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957643 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957643 AND mptpi.`type`=4230 To do Qualite : 0.19586536514647981 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957644_03-03-2025_01_45_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957644 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957644 AND mptpi.`type`=4230 To do Qualite : 0.2092123416974779 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957645_03-03-2025_01_33_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957645 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957645 AND mptpi.`type`=4230 To do Qualite : 0.20638085550742077 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957646_03-03-2025_01_22_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957646 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957646 AND mptpi.`type`=4230 To do Qualite : 0.22146667136123907 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957647_03-03-2025_01_16_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957647 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957647 AND mptpi.`type`=4230 To do Qualite : 0.19152548119984242 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957648_03-03-2025_00_51_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957648 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957648 AND mptpi.`type`=4230 To do Qualite : 0.22877186881093695 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957649_03-03-2025_00_48_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957649 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957649 AND mptpi.`type`=4230 To do Qualite : 0.23421457348364924 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957650_03-03-2025_00_52_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957650 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957650 AND mptpi.`type`=4230 To do Qualite : 0.2245714344163915 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957651_03-03-2025_00_34_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957651 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957651 AND mptpi.`type`=4230 To do Qualite : 0.22212740105907633 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957652_03-03-2025_00_32_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957652 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957652 AND mptpi.`type`=4230 To do Qualite : 0.21121739094852754 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957653_03-03-2025_00_18_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957653 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957653 AND mptpi.`type`=4230 To do Qualite : 0.22036621398782735 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957654_03-03-2025_00_12_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957654 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957654 AND mptpi.`type`=4230 To do Qualite : 0.20524542589930503 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957655_03-03-2025_00_17_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957655 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957655 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'02032025': {'nb_upload': 3, 'nb_taggue_class': 3, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1340529049, 1340529032, 1340529031] Looping around the photos to save general results len do output : 1 /20957633Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529049', None, None, None, None, None, '2627694') ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529032', None, None, None, None, None, '2627694') ('4234', None, None, None, None, None, None, None, '2627694') ('4234', '20957633', '1340529031', None, None, None, None, None, '2627694') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.07378482818603516 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.014970302581787 time spend to save output : 0.0740060806274414 total time spend for step 11 : 10.088976383209229 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 3 set_done_treatment 38.75user 25.89system 2:51.32elapsed 37%CPU (0avgtext+0avgdata 2491740maxresident)k 480inputs+13328outputs (7major+2052504minor)pagefaults 0swaps