python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4909 -l 10 ' -s datou_current_4909 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3674520 load datou : 4909 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? id de la photo (peut être local ou global) was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5359, 'Mask_Limeil_Label_PEHD_080621', 16384, 25088, 'Mask_Limeil_Label_PEHD_080621', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 6, 9, 7, 22, 34), datetime.datetime(2021, 6, 9, 7, 22, 34)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5557, 'learn_generique_01122021_6000_v2', 2048, 2048, 'learn_generique_01122021_6000_v2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 1, 19, 59, 17), datetime.datetime(2021, 12, 1, 19, 59, 17)) load thcls load THCL from format json or kwargs add thcl : 2976 in CacheModelConfig load THCL from format json or kwargs add thcl : 3233 in CacheModelConfig load pdts add pdt : 5359 in CacheModelConfig add pdt : 5557 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 23>10 please execute split_portfolio.py -i 20101919 -l 10 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4909, datou_cur_ids : ['2532921'] with mtr_portfolio_ids : ['20101919'] and first list_photo_ids : [] new path : /proc/3674520/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, blur_detection, brightness, crop_condition, thcl, argmax, merge_mask_thcl_custom, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 2.81962513923645 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 14 step1:mask_detect Sat Feb 1 07:34:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-01 07:34:33.636014: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-01 07:34:33.663535: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493020000 Hz 2025-02-01 07:34:33.665111: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fc628000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-01 07:34:33.665169: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-01 07:34:33.668035: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-01 07:34:33.955040: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2ca42700 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-01 07:34:33.955097: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-01 07:34:33.956155: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 07:34:33.956500: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 07:34:33.958597: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 07:34:33.960785: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 07:34:33.961115: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 07:34:33.963419: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 07:34:33.964562: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 07:34:33.969766: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 07:34:33.971741: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 07:34:33.971873: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 07:34:33.972876: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 07:34:33.972894: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 07:34:33.972905: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 07:34:33.974911: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-01 07:34:34.268476: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 07:34:34.268591: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 07:34:34.268608: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 07:34:34.268623: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 07:34:34.268637: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 07:34:34.268651: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 07:34:34.268664: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 07:34:34.268678: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 07:34:34.269896: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 07:34:34.270971: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 07:34:34.270998: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 07:34:34.271012: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 07:34:34.271025: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 07:34:34.271038: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 07:34:34.271051: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 07:34:34.271064: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 07:34:34.271076: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 07:34:34.272331: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 07:34:34.272366: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 07:34:34.272375: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 07:34:34.272383: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 07:34:34.273647: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2976 thcls : [{'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5359 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5359, 'Mask_Limeil_Label_PEHD_080621', 16384, 25088, 'Mask_Limeil_Label_PEHD_080621', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 6, 9, 7, 22, 34), datetime.datetime(2021, 6, 9, 7, 22, 34)) {'thcl': {'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'environnement', 'fibreux_cont', 'metal_cont', 'pet_clair_cont', 'pet_fonce_cont', 'pet_opaque_cont', 'barquette', 'film_plastique', 'autre_contaminant', 'etiquette_detachee'], 'list_hashtags_csv': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'svm_hashtag_type_desc': 5359, 'photo_desc_type': 5359, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'environnement', 'fibreux_cont', 'metal_cont', 'pet_clair_cont', 'pet_fonce_cont', 'pet_opaque_cont', 'barquette', 'film_plastique', 'autre_contaminant', 'etiquette_detachee'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME Mask_Limeil_Label_PEHD_080621 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : Mask_Limeil_Label_PEHD_080621 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-01 07:34:44.400541: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 07:34:44.561380: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/Mask_Limeil_Label_PEHD_080621 /data/models_weight/Mask_Limeil_Label_PEHD_080621/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2021-08-11 19:43:15 create time in s3 : 2021-08-06 17:21:30 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.10000 image_metas shape: (1, 19) min: 0.00000 max: 3840.00000 nb d'objets trouves : 60 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.35000 image_metas shape: (1, 19) min: 0.00000 max: 3840.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.10000 image_metas shape: (1, 19) min: 0.00000 max: 3840.00000 nb d'objets trouves : 84 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.60000 image_metas shape: (1, 19) min: 0.00000 max: 3840.00000 nb d'objets trouves : 69 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.10000 image_metas shape: (1, 19) min: 0.00000 max: 3840.00000 nb d'objets trouves : 75 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.10000 image_metas shape: (1, 19) min: 0.00000 max: 3840.00000 nb d'objets trouves : 88 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.35000 image_metas shape: (1, 19) min: 0.00000 max: 3840.00000 nb d'objets trouves : 77 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.85000 image_metas shape: (1, 19) min: 0.00000 max: 3840.00000 nb d'objets trouves : 78 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.10000 image_metas shape: (1, 19) min: 0.00000 max: 3840.00000 nb d'objets trouves : 66 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.60000 image_metas shape: (1, 19) min: 0.00000 max: 3840.00000 nb d'objets trouves : 75 Detection mask done ! Trying to reset tf kernel 3674970 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4513 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10998 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2976 Catched exception ! Connect or reconnect ! thcls : [{'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5359 ['background', 'environnement', 'fibreux_cont', 'metal_cont', 'pet_clair_cont', 'pet_fonce_cont', 'pet_opaque_cont', 'barquette', 'film_plastique', 'autre_contaminant', 'etiquette_detachee'] time for calcul the mask position with numpy : 0.1338181495666504 nb_pixel_total : 279346 time to create 1 rle with new method : 0.029264450073242188 length of segment : 770 time for calcul the mask position with numpy : 0.04325079917907715 nb_pixel_total : 478343 time to create 1 rle with new method : 0.03869223594665527 length of segment : 1007 time for calcul the mask position with numpy : 0.008452177047729492 nb_pixel_total : 449354 time to create 1 rle with new method : 0.02680230140686035 length of segment : 679 time for calcul the mask position with numpy : 0.00641942024230957 nb_pixel_total : 232365 time to create 1 rle with new method : 0.12738656997680664 length of segment : 784 time for calcul the mask position with numpy : 0.00624847412109375 nb_pixel_total : 206369 time to create 1 rle with new method : 0.015278339385986328 length of segment : 610 time for calcul the mask position with numpy : 0.0009233951568603516 nb_pixel_total : 36683 time to create 1 rle with old method : 0.043193817138671875 length of segment : 199 time for calcul the mask position with numpy : 0.009141683578491211 nb_pixel_total : 433126 time to create 1 rle with new method : 0.026420116424560547 length of segment : 895 time for calcul the mask position with numpy : 0.0005357265472412109 nb_pixel_total : 19413 time to create 1 rle with old method : 0.02131509780883789 length of segment : 177 time for calcul the mask position with numpy : 0.0009369850158691406 nb_pixel_total : 20732 time to create 1 rle with old method : 0.024457216262817383 length of segment : 169 time for calcul the mask position with numpy : 0.13238263130187988 nb_pixel_total : 494732 time to create 1 rle with new method : 0.04092979431152344 length of segment : 718 time for calcul the mask position with numpy : 0.001146554946899414 nb_pixel_total : 37890 time to create 1 rle with old method : 0.04883456230163574 length of segment : 247 time for calcul the mask position with numpy : 0.0007052421569824219 nb_pixel_total : 28816 time to create 1 rle with old method : 0.03265953063964844 length of segment : 220 time for calcul the mask position with numpy : 0.0008924007415771484 nb_pixel_total : 9874 time to create 1 rle with old method : 0.011845588684082031 length of segment : 123 time for calcul the mask position with numpy : 0.0010004043579101562 nb_pixel_total : 39443 time to create 1 rle with old method : 0.04339194297790527 length of segment : 334 time for calcul the mask position with numpy : 0.008941173553466797 nb_pixel_total : 418433 time to create 1 rle with new method : 0.041442155838012695 length of segment : 1214 time for calcul the mask position with numpy : 0.007676839828491211 nb_pixel_total : 62904 time to create 1 rle with old method : 0.07184076309204102 length of segment : 363 time for calcul the mask position with numpy : 0.0009477138519287109 nb_pixel_total : 14424 time to create 1 rle with old method : 0.02360677719116211 length of segment : 174 time for calcul the mask position with numpy : 0.0015676021575927734 nb_pixel_total : 18465 time to create 1 rle with old method : 0.022139549255371094 length of segment : 163 time for calcul the mask position with numpy : 0.006459951400756836 nb_pixel_total : 298193 time to create 1 rle with new method : 0.03333926200866699 length of segment : 733 time for calcul the mask position with numpy : 0.0011544227600097656 nb_pixel_total : 29786 time to create 1 rle with old method : 0.0428011417388916 length of segment : 303 time for calcul the mask position with numpy : 0.0013670921325683594 nb_pixel_total : 19186 time to create 1 rle with old method : 0.022528886795043945 length of segment : 132 time for calcul the mask position with numpy : 0.002454042434692383 nb_pixel_total : 46517 time to create 1 rle with old method : 0.051737070083618164 length of segment : 264 time for calcul the mask position with numpy : 0.0012927055358886719 nb_pixel_total : 60253 time to create 1 rle with old method : 0.07022261619567871 length of segment : 208 time for calcul the mask position with numpy : 0.0025482177734375 nb_pixel_total : 119141 time to create 1 rle with old method : 0.13112831115722656 length of segment : 536 time for calcul the mask position with numpy : 0.0022270679473876953 nb_pixel_total : 8410 time to create 1 rle with old method : 0.013640642166137695 length of segment : 139 time for calcul the mask position with numpy : 0.004178524017333984 nb_pixel_total : 54008 time to create 1 rle with old method : 0.07423686981201172 length of segment : 348 time for calcul the mask position with numpy : 0.0027878284454345703 nb_pixel_total : 78155 time to create 1 rle with old method : 0.0877838134765625 length of segment : 488 time for calcul the mask position with numpy : 0.004254579544067383 nb_pixel_total : 98675 time to create 1 rle with old method : 0.1116342544555664 length of segment : 680 time for calcul the mask position with numpy : 0.0010068416595458984 nb_pixel_total : 31072 time to create 1 rle with old method : 0.03386116027832031 length of segment : 291 time for calcul the mask position with numpy : 0.002044200897216797 nb_pixel_total : 85866 time to create 1 rle with old method : 0.0939176082611084 length of segment : 377 time for calcul the mask position with numpy : 0.0001513957977294922 nb_pixel_total : 5022 time to create 1 rle with old method : 0.005704164505004883 length of segment : 85 time for calcul the mask position with numpy : 0.04492783546447754 nb_pixel_total : 272632 time to create 1 rle with new method : 0.014531373977661133 length of segment : 603 time for calcul the mask position with numpy : 0.014499425888061523 nb_pixel_total : 51355 time to create 1 rle with old method : 0.0612180233001709 length of segment : 311 time for calcul the mask position with numpy : 0.07921862602233887 nb_pixel_total : 329891 time to create 1 rle with new method : 0.038394927978515625 length of segment : 1066 time for calcul the mask position with numpy : 0.0462794303894043 nb_pixel_total : 276055 time to create 1 rle with new method : 0.021142959594726562 length of segment : 646 time for calcul the mask position with numpy : 0.02718210220336914 nb_pixel_total : 394179 time to create 1 rle with new method : 0.018074512481689453 length of segment : 673 time for calcul the mask position with numpy : 0.06230497360229492 nb_pixel_total : 443771 time to create 1 rle with new method : 0.02624034881591797 length of segment : 901 time for calcul the mask position with numpy : 0.001438140869140625 nb_pixel_total : 32449 time to create 1 rle with old method : 0.039952993392944336 length of segment : 224 time for calcul the mask position with numpy : 0.015433311462402344 nb_pixel_total : 462490 time to create 1 rle with new method : 0.025116920471191406 length of segment : 865 time for calcul the mask position with numpy : 0.01552438735961914 nb_pixel_total : 65010 time to create 1 rle with old method : 0.08184051513671875 length of segment : 249 time for calcul the mask position with numpy : 0.027832984924316406 nb_pixel_total : 325186 time to create 1 rle with new method : 0.01593017578125 length of segment : 593 time for calcul the mask position with numpy : 0.027086257934570312 nb_pixel_total : 381787 time to create 1 rle with new method : 0.02364516258239746 length of segment : 792 time for calcul the mask position with numpy : 0.008424997329711914 nb_pixel_total : 46599 time to create 1 rle with old method : 0.05642580986022949 length of segment : 306 time for calcul the mask position with numpy : 0.046927452087402344 nb_pixel_total : 357135 time to create 1 rle with new method : 0.034430503845214844 length of segment : 673 time for calcul the mask position with numpy : 0.010627985000610352 nb_pixel_total : 43629 time to create 1 rle with old method : 0.053835391998291016 length of segment : 269 time for calcul the mask position with numpy : 0.0008707046508789062 nb_pixel_total : 29682 time to create 1 rle with old method : 0.0333561897277832 length of segment : 141 time for calcul the mask position with numpy : 0.004942178726196289 nb_pixel_total : 52434 time to create 1 rle with old method : 0.06163620948791504 length of segment : 321 time for calcul the mask position with numpy : 0.017989635467529297 nb_pixel_total : 343551 time to create 1 rle with new method : 0.061484575271606445 length of segment : 724 time for calcul the mask position with numpy : 0.009562492370605469 nb_pixel_total : 306045 time to create 1 rle with new method : 0.015717506408691406 length of segment : 776 time for calcul the mask position with numpy : 0.004001617431640625 nb_pixel_total : 83574 time to create 1 rle with old method : 0.0963888168334961 length of segment : 339 time for calcul the mask position with numpy : 0.01873922348022461 nb_pixel_total : 267236 time to create 1 rle with new method : 0.03195762634277344 length of segment : 675 time for calcul the mask position with numpy : 0.019127607345581055 nb_pixel_total : 87641 time to create 1 rle with old method : 0.1052706241607666 length of segment : 630 time for calcul the mask position with numpy : 0.0016930103302001953 nb_pixel_total : 41429 time to create 1 rle with old method : 0.04802393913269043 length of segment : 301 time for calcul the mask position with numpy : 0.0018868446350097656 nb_pixel_total : 71391 time to create 1 rle with old method : 0.08959102630615234 length of segment : 202 time for calcul the mask position with numpy : 0.0007255077362060547 nb_pixel_total : 12289 time to create 1 rle with old method : 0.013564348220825195 length of segment : 185 time for calcul the mask position with numpy : 0.017174959182739258 nb_pixel_total : 363870 time to create 1 rle with new method : 0.019060373306274414 length of segment : 647 time for calcul the mask position with numpy : 0.019594669342041016 nb_pixel_total : 273666 time to create 1 rle with new method : 0.02175164222717285 length of segment : 982 time for calcul the mask position with numpy : 0.0008182525634765625 nb_pixel_total : 9199 time to create 1 rle with old method : 0.015279531478881836 length of segment : 110 time for calcul the mask position with numpy : 0.004105806350708008 nb_pixel_total : 55084 time to create 1 rle with old method : 0.0636591911315918 length of segment : 225 time for calcul the mask position with numpy : 0.016768455505371094 nb_pixel_total : 269195 time to create 1 rle with new method : 0.019628524780273438 length of segment : 935 time for calcul the mask position with numpy : 0.004166364669799805 nb_pixel_total : 65587 time to create 1 rle with old method : 0.07663512229919434 length of segment : 304 time for calcul the mask position with numpy : 0.020467758178710938 nb_pixel_total : 310445 time to create 1 rle with new method : 0.02630138397216797 length of segment : 706 time for calcul the mask position with numpy : 0.0014677047729492188 nb_pixel_total : 22785 time to create 1 rle with old method : 0.02539229393005371 length of segment : 145 time for calcul the mask position with numpy : 0.005864381790161133 nb_pixel_total : 83742 time to create 1 rle with old method : 0.09189057350158691 length of segment : 640 time for calcul the mask position with numpy : 0.023230791091918945 nb_pixel_total : 370962 time to create 1 rle with new method : 0.048975229263305664 length of segment : 883 time for calcul the mask position with numpy : 0.0014297962188720703 nb_pixel_total : 65557 time to create 1 rle with old method : 0.07407999038696289 length of segment : 339 time for calcul the mask position with numpy : 0.018755197525024414 nb_pixel_total : 468016 time to create 1 rle with new method : 0.028343677520751953 length of segment : 989 time for calcul the mask position with numpy : 0.012318849563598633 nb_pixel_total : 209811 time to create 1 rle with new method : 0.016690969467163086 length of segment : 470 time for calcul the mask position with numpy : 0.001897573471069336 nb_pixel_total : 16451 time to create 1 rle with old method : 0.0217740535736084 length of segment : 184 time for calcul the mask position with numpy : 0.005705356597900391 nb_pixel_total : 71695 time to create 1 rle with old method : 0.08178186416625977 length of segment : 297 time for calcul the mask position with numpy : 0.0004508495330810547 nb_pixel_total : 5241 time to create 1 rle with old method : 0.005967140197753906 length of segment : 103 time for calcul the mask position with numpy : 0.005374431610107422 nb_pixel_total : 67980 time to create 1 rle with old method : 0.07908082008361816 length of segment : 380 time for calcul the mask position with numpy : 0.0038094520568847656 nb_pixel_total : 51318 time to create 1 rle with old method : 0.05669236183166504 length of segment : 357 time for calcul the mask position with numpy : 0.005251169204711914 nb_pixel_total : 102350 time to create 1 rle with old method : 0.1165306568145752 length of segment : 472 time for calcul the mask position with numpy : 0.01922750473022461 nb_pixel_total : 247597 time to create 1 rle with new method : 0.03279900550842285 length of segment : 677 time for calcul the mask position with numpy : 0.003534078598022461 nb_pixel_total : 55660 time to create 1 rle with old method : 0.06348633766174316 length of segment : 299 time for calcul the mask position with numpy : 0.0008184909820556641 nb_pixel_total : 20889 time to create 1 rle with old method : 0.023378610610961914 length of segment : 164 time for calcul the mask position with numpy : 0.00321197509765625 nb_pixel_total : 27913 time to create 1 rle with old method : 0.03267097473144531 length of segment : 243 time for calcul the mask position with numpy : 0.0019330978393554688 nb_pixel_total : 30708 time to create 1 rle with old method : 0.03323984146118164 length of segment : 209 time for calcul the mask position with numpy : 0.006197690963745117 nb_pixel_total : 84551 time to create 1 rle with old method : 0.09713506698608398 length of segment : 336 time for calcul the mask position with numpy : 0.005141496658325195 nb_pixel_total : 87703 time to create 1 rle with old method : 0.11783957481384277 length of segment : 569 time for calcul the mask position with numpy : 0.003136157989501953 nb_pixel_total : 127079 time to create 1 rle with old method : 0.13738465309143066 length of segment : 698 time for calcul the mask position with numpy : 0.001977205276489258 nb_pixel_total : 24599 time to create 1 rle with old method : 0.0282135009765625 length of segment : 134 time for calcul the mask position with numpy : 0.0007746219635009766 nb_pixel_total : 11314 time to create 1 rle with old method : 0.01291799545288086 length of segment : 110 time for calcul the mask position with numpy : 0.002817392349243164 nb_pixel_total : 43626 time to create 1 rle with old method : 0.049150943756103516 length of segment : 295 time for calcul the mask position with numpy : 0.014251470565795898 nb_pixel_total : 188800 time to create 1 rle with new method : 0.019442081451416016 length of segment : 920 time for calcul the mask position with numpy : 0.0012547969818115234 nb_pixel_total : 43388 time to create 1 rle with old method : 0.04738354682922363 length of segment : 322 time for calcul the mask position with numpy : 0.013131856918334961 nb_pixel_total : 231441 time to create 1 rle with new method : 0.018304109573364258 length of segment : 511 time for calcul the mask position with numpy : 0.0013663768768310547 nb_pixel_total : 9846 time to create 1 rle with old method : 0.011943578720092773 length of segment : 111 time for calcul the mask position with numpy : 0.0031054019927978516 nb_pixel_total : 38782 time to create 1 rle with old method : 0.0420680046081543 length of segment : 185 time for calcul the mask position with numpy : 0.0032117366790771484 nb_pixel_total : 32074 time to create 1 rle with old method : 0.03686189651489258 length of segment : 356 time for calcul the mask position with numpy : 0.0007917881011962891 nb_pixel_total : 19709 time to create 1 rle with old method : 0.022206544876098633 length of segment : 151 time for calcul the mask position with numpy : 0.002151966094970703 nb_pixel_total : 31694 time to create 1 rle with old method : 0.03686237335205078 length of segment : 228 time for calcul the mask position with numpy : 0.0019617080688476562 nb_pixel_total : 31970 time to create 1 rle with old method : 0.03638195991516113 length of segment : 215 time for calcul the mask position with numpy : 0.0010783672332763672 nb_pixel_total : 12313 time to create 1 rle with old method : 0.014278650283813477 length of segment : 115 time for calcul the mask position with numpy : 0.0032689571380615234 nb_pixel_total : 55759 time to create 1 rle with old method : 0.06281638145446777 length of segment : 291 time for calcul the mask position with numpy : 0.005834341049194336 nb_pixel_total : 111512 time to create 1 rle with old method : 0.12633538246154785 length of segment : 341 time for calcul the mask position with numpy : 0.002451181411743164 nb_pixel_total : 61600 time to create 1 rle with old method : 0.07050299644470215 length of segment : 318 time for calcul the mask position with numpy : 0.001049041748046875 nb_pixel_total : 36047 time to create 1 rle with old method : 0.03966474533081055 length of segment : 183 time for calcul the mask position with numpy : 0.018105268478393555 nb_pixel_total : 417229 time to create 1 rle with new method : 0.028244495391845703 length of segment : 813 time for calcul the mask position with numpy : 0.01900959014892578 nb_pixel_total : 351035 time to create 1 rle with new method : 0.030863046646118164 length of segment : 578 time for calcul the mask position with numpy : 0.02181267738342285 nb_pixel_total : 430871 time to create 1 rle with new method : 0.024603843688964844 length of segment : 688 time for calcul the mask position with numpy : 0.0061528682708740234 nb_pixel_total : 130180 time to create 1 rle with old method : 0.1481478214263916 length of segment : 370 time for calcul the mask position with numpy : 0.00393223762512207 nb_pixel_total : 102243 time to create 1 rle with old method : 0.11647224426269531 length of segment : 345 time for calcul the mask position with numpy : 0.0014026165008544922 nb_pixel_total : 37925 time to create 1 rle with old method : 0.04150962829589844 length of segment : 241 time for calcul the mask position with numpy : 0.014464139938354492 nb_pixel_total : 153750 time to create 1 rle with new method : 0.013548612594604492 length of segment : 541 time for calcul the mask position with numpy : 0.01565837860107422 nb_pixel_total : 403670 time to create 1 rle with new method : 0.03162741661071777 length of segment : 959 time for calcul the mask position with numpy : 0.01670098304748535 nb_pixel_total : 292817 time to create 1 rle with new method : 0.03601861000061035 length of segment : 609 time for calcul the mask position with numpy : 0.002064943313598633 nb_pixel_total : 37357 time to create 1 rle with old method : 0.043365478515625 length of segment : 177 time for calcul the mask position with numpy : 0.0019402503967285156 nb_pixel_total : 34123 time to create 1 rle with old method : 0.039475440979003906 length of segment : 237 time for calcul the mask position with numpy : 0.0021822452545166016 nb_pixel_total : 50379 time to create 1 rle with old method : 0.05452084541320801 length of segment : 288 time for calcul the mask position with numpy : 0.010654926300048828 nb_pixel_total : 241765 time to create 1 rle with new method : 0.0193026065826416 length of segment : 609 time for calcul the mask position with numpy : 0.001329183578491211 nb_pixel_total : 14713 time to create 1 rle with old method : 0.016756534576416016 length of segment : 132 time for calcul the mask position with numpy : 0.006367683410644531 nb_pixel_total : 119640 time to create 1 rle with old method : 0.14905142784118652 length of segment : 442 time for calcul the mask position with numpy : 0.011738300323486328 nb_pixel_total : 212664 time to create 1 rle with new method : 0.0332334041595459 length of segment : 646 time for calcul the mask position with numpy : 0.0027666091918945312 nb_pixel_total : 142419 time to create 1 rle with old method : 0.15570831298828125 length of segment : 475 time for calcul the mask position with numpy : 0.001886606216430664 nb_pixel_total : 29748 time to create 1 rle with old method : 0.033093929290771484 length of segment : 181 time for calcul the mask position with numpy : 0.0018849372863769531 nb_pixel_total : 28492 time to create 1 rle with old method : 0.034500837326049805 length of segment : 214 time for calcul the mask position with numpy : 0.010152578353881836 nb_pixel_total : 277559 time to create 1 rle with new method : 0.018552064895629883 length of segment : 1021 time for calcul the mask position with numpy : 0.004177570343017578 nb_pixel_total : 54914 time to create 1 rle with old method : 0.06213521957397461 length of segment : 472 time for calcul the mask position with numpy : 0.0010111331939697266 nb_pixel_total : 34342 time to create 1 rle with old method : 0.037720680236816406 length of segment : 208 time for calcul the mask position with numpy : 0.00756072998046875 nb_pixel_total : 189837 time to create 1 rle with new method : 0.019186735153198242 length of segment : 1136 time for calcul the mask position with numpy : 0.0020940303802490234 nb_pixel_total : 36222 time to create 1 rle with old method : 0.043770551681518555 length of segment : 172 time for calcul the mask position with numpy : 0.012908458709716797 nb_pixel_total : 261877 time to create 1 rle with new method : 0.02359914779663086 length of segment : 685 time for calcul the mask position with numpy : 0.002965211868286133 nb_pixel_total : 62171 time to create 1 rle with old method : 0.07274603843688965 length of segment : 301 time for calcul the mask position with numpy : 0.004106760025024414 nb_pixel_total : 66482 time to create 1 rle with old method : 0.07626724243164062 length of segment : 550 time for calcul the mask position with numpy : 0.0020780563354492188 nb_pixel_total : 53700 time to create 1 rle with old method : 0.05930614471435547 length of segment : 307 time for calcul the mask position with numpy : 0.0018723011016845703 nb_pixel_total : 12851 time to create 1 rle with old method : 0.013891220092773438 length of segment : 204 time for calcul the mask position with numpy : 0.0019063949584960938 nb_pixel_total : 71267 time to create 1 rle with old method : 0.07652163505554199 length of segment : 442 time for calcul the mask position with numpy : 0.011087417602539062 nb_pixel_total : 110066 time to create 1 rle with old method : 0.12481164932250977 length of segment : 335 time for calcul the mask position with numpy : 0.005329132080078125 nb_pixel_total : 99971 time to create 1 rle with old method : 0.13568329811096191 length of segment : 425 time for calcul the mask position with numpy : 0.005831003189086914 nb_pixel_total : 106306 time to create 1 rle with old method : 0.11737346649169922 length of segment : 494 time for calcul the mask position with numpy : 0.0012145042419433594 nb_pixel_total : 12628 time to create 1 rle with old method : 0.014330625534057617 length of segment : 242 time for calcul the mask position with numpy : 0.0008547306060791016 nb_pixel_total : 21709 time to create 1 rle with old method : 0.02413201332092285 length of segment : 243 time for calcul the mask position with numpy : 0.0004229545593261719 nb_pixel_total : 11653 time to create 1 rle with old method : 0.013032913208007812 length of segment : 85 time for calcul the mask position with numpy : 0.001829385757446289 nb_pixel_total : 29144 time to create 1 rle with old method : 0.03426790237426758 length of segment : 217 time for calcul the mask position with numpy : 0.0017375946044921875 nb_pixel_total : 17413 time to create 1 rle with old method : 0.019464969635009766 length of segment : 150 time for calcul the mask position with numpy : 0.0064623355865478516 nb_pixel_total : 13370 time to create 1 rle with old method : 0.0161135196685791 length of segment : 264 time for calcul the mask position with numpy : 0.022507667541503906 nb_pixel_total : 406082 time to create 1 rle with new method : 0.03509044647216797 length of segment : 800 time for calcul the mask position with numpy : 0.0162808895111084 nb_pixel_total : 418710 time to create 1 rle with new method : 0.025525569915771484 length of segment : 620 time for calcul the mask position with numpy : 0.0206146240234375 nb_pixel_total : 447119 time to create 1 rle with new method : 0.034886837005615234 length of segment : 782 time for calcul the mask position with numpy : 0.0028994083404541016 nb_pixel_total : 53505 time to create 1 rle with old method : 0.05900001525878906 length of segment : 260 time for calcul the mask position with numpy : 0.002357006072998047 nb_pixel_total : 44894 time to create 1 rle with old method : 0.052046775817871094 length of segment : 219 time for calcul the mask position with numpy : 0.03502297401428223 nb_pixel_total : 521369 time to create 1 rle with new method : 0.06342053413391113 length of segment : 1412 time for calcul the mask position with numpy : 0.018843412399291992 nb_pixel_total : 363952 time to create 1 rle with new method : 0.023007631301879883 length of segment : 665 time for calcul the mask position with numpy : 0.004538774490356445 nb_pixel_total : 97209 time to create 1 rle with old method : 0.12261223793029785 length of segment : 338 time for calcul the mask position with numpy : 0.0009810924530029297 nb_pixel_total : 43068 time to create 1 rle with old method : 0.05410313606262207 length of segment : 458 time for calcul the mask position with numpy : 0.0030257701873779297 nb_pixel_total : 53217 time to create 1 rle with old method : 0.06057929992675781 length of segment : 229 time for calcul the mask position with numpy : 0.0009055137634277344 nb_pixel_total : 16255 time to create 1 rle with old method : 0.0180819034576416 length of segment : 177 time for calcul the mask position with numpy : 0.01070404052734375 nb_pixel_total : 268678 time to create 1 rle with new method : 0.01859736442565918 length of segment : 865 time for calcul the mask position with numpy : 0.00047087669372558594 nb_pixel_total : 8629 time to create 1 rle with old method : 0.009783029556274414 length of segment : 132 time for calcul the mask position with numpy : 0.009445905685424805 nb_pixel_total : 275281 time to create 1 rle with new method : 0.018872499465942383 length of segment : 614 time for calcul the mask position with numpy : 0.0029926300048828125 nb_pixel_total : 65734 time to create 1 rle with old method : 0.07192635536193848 length of segment : 236 time for calcul the mask position with numpy : 0.005686521530151367 nb_pixel_total : 124267 time to create 1 rle with old method : 0.13765287399291992 length of segment : 388 time for calcul the mask position with numpy : 0.0006597042083740234 nb_pixel_total : 9659 time to create 1 rle with old method : 0.011178970336914062 length of segment : 83 time for calcul the mask position with numpy : 0.006563901901245117 nb_pixel_total : 114175 time to create 1 rle with old method : 0.12201786041259766 length of segment : 389 time for calcul the mask position with numpy : 0.01569819450378418 nb_pixel_total : 290135 time to create 1 rle with new method : 0.03870034217834473 length of segment : 809 time for calcul the mask position with numpy : 0.018404483795166016 nb_pixel_total : 267663 time to create 1 rle with new method : 0.03843808174133301 length of segment : 808 time for calcul the mask position with numpy : 0.0023431777954101562 nb_pixel_total : 40616 time to create 1 rle with old method : 0.04494905471801758 length of segment : 278 time for calcul the mask position with numpy : 0.012044191360473633 nb_pixel_total : 182816 time to create 1 rle with new method : 0.026322364807128906 length of segment : 913 time for calcul the mask position with numpy : 0.005052804946899414 nb_pixel_total : 107829 time to create 1 rle with old method : 0.14489459991455078 length of segment : 402 time for calcul the mask position with numpy : 0.0005345344543457031 nb_pixel_total : 9151 time to create 1 rle with old method : 0.010113716125488281 length of segment : 122 time for calcul the mask position with numpy : 0.004251718521118164 nb_pixel_total : 87836 time to create 1 rle with old method : 0.0997927188873291 length of segment : 252 time for calcul the mask position with numpy : 0.0037698745727539062 nb_pixel_total : 103086 time to create 1 rle with old method : 0.11020016670227051 length of segment : 301 time for calcul the mask position with numpy : 0.005510091781616211 nb_pixel_total : 88751 time to create 1 rle with old method : 0.09761333465576172 length of segment : 405 time for calcul the mask position with numpy : 0.00112152099609375 nb_pixel_total : 26834 time to create 1 rle with old method : 0.02936387062072754 length of segment : 102 time for calcul the mask position with numpy : 0.0003502368927001953 nb_pixel_total : 15172 time to create 1 rle with old method : 0.016756057739257812 length of segment : 133 time for calcul the mask position with numpy : 0.0009191036224365234 nb_pixel_total : 25982 time to create 1 rle with old method : 0.030089855194091797 length of segment : 207 time for calcul the mask position with numpy : 0.00047397613525390625 nb_pixel_total : 22791 time to create 1 rle with old method : 0.02476954460144043 length of segment : 149 time for calcul the mask position with numpy : 0.0005066394805908203 nb_pixel_total : 20774 time to create 1 rle with old method : 0.021713972091674805 length of segment : 175 time for calcul the mask position with numpy : 0.0030150413513183594 nb_pixel_total : 63117 time to create 1 rle with old method : 0.06957554817199707 length of segment : 232 time for calcul the mask position with numpy : 0.0006227493286132812 nb_pixel_total : 28465 time to create 1 rle with old method : 0.031554222106933594 length of segment : 231 time for calcul the mask position with numpy : 0.0013899803161621094 nb_pixel_total : 64279 time to create 1 rle with old method : 0.06744670867919922 length of segment : 256 time for calcul the mask position with numpy : 0.005482196807861328 nb_pixel_total : 98158 time to create 1 rle with old method : 0.10210061073303223 length of segment : 285 time for calcul the mask position with numpy : 0.0007593631744384766 nb_pixel_total : 14786 time to create 1 rle with old method : 0.018867969512939453 length of segment : 127 time for calcul the mask position with numpy : 0.0008416175842285156 nb_pixel_total : 13288 time to create 1 rle with old method : 0.014633417129516602 length of segment : 147 time for calcul the mask position with numpy : 0.0073146820068359375 nb_pixel_total : 135557 time to create 1 rle with old method : 0.1479966640472412 length of segment : 394 time for calcul the mask position with numpy : 0.0007395744323730469 nb_pixel_total : 13859 time to create 1 rle with old method : 0.014920234680175781 length of segment : 144 time for calcul the mask position with numpy : 0.0020766258239746094 nb_pixel_total : 36314 time to create 1 rle with old method : 0.040576934814453125 length of segment : 203 time for calcul the mask position with numpy : 0.019849061965942383 nb_pixel_total : 372264 time to create 1 rle with new method : 0.02699899673461914 length of segment : 602 time for calcul the mask position with numpy : 0.002658843994140625 nb_pixel_total : 37445 time to create 1 rle with old method : 0.03932309150695801 length of segment : 245 time for calcul the mask position with numpy : 0.01780843734741211 nb_pixel_total : 420430 time to create 1 rle with new method : 0.021212339401245117 length of segment : 734 time for calcul the mask position with numpy : 0.018990755081176758 nb_pixel_total : 416666 time to create 1 rle with new method : 0.027193546295166016 length of segment : 848 time for calcul the mask position with numpy : 0.025199413299560547 nb_pixel_total : 437130 time to create 1 rle with new method : 0.04258990287780762 length of segment : 1043 time for calcul the mask position with numpy : 0.015735864639282227 nb_pixel_total : 245203 time to create 1 rle with new method : 0.02188420295715332 length of segment : 945 time for calcul the mask position with numpy : 0.0055315494537353516 nb_pixel_total : 85343 time to create 1 rle with old method : 0.08784174919128418 length of segment : 401 time for calcul the mask position with numpy : 0.0017511844635009766 nb_pixel_total : 26427 time to create 1 rle with old method : 0.02797222137451172 length of segment : 247 time for calcul the mask position with numpy : 0.019983530044555664 nb_pixel_total : 210659 time to create 1 rle with new method : 0.03193330764770508 length of segment : 729 time for calcul the mask position with numpy : 0.01984548568725586 nb_pixel_total : 184579 time to create 1 rle with new method : 0.029853105545043945 length of segment : 513 time for calcul the mask position with numpy : 0.0023539066314697266 nb_pixel_total : 27539 time to create 1 rle with old method : 0.0314021110534668 length of segment : 237 time for calcul the mask position with numpy : 0.0014078617095947266 nb_pixel_total : 27695 time to create 1 rle with old method : 0.028776168823242188 length of segment : 208 time for calcul the mask position with numpy : 0.0010521411895751953 nb_pixel_total : 13327 time to create 1 rle with old method : 0.014032363891601562 length of segment : 163 time for calcul the mask position with numpy : 0.014346599578857422 nb_pixel_total : 180199 time to create 1 rle with new method : 0.017763376235961914 length of segment : 941 time for calcul the mask position with numpy : 0.0015041828155517578 nb_pixel_total : 23646 time to create 1 rle with old method : 0.026740074157714844 length of segment : 195 time for calcul the mask position with numpy : 0.0011844635009765625 nb_pixel_total : 50043 time to create 1 rle with old method : 0.05177950859069824 length of segment : 174 time for calcul the mask position with numpy : 0.001909494400024414 nb_pixel_total : 29950 time to create 1 rle with old method : 0.03063511848449707 length of segment : 250 time for calcul the mask position with numpy : 0.014462709426879883 nb_pixel_total : 168442 time to create 1 rle with new method : 0.01904773712158203 length of segment : 685 time for calcul the mask position with numpy : 0.01082301139831543 nb_pixel_total : 325394 time to create 1 rle with new method : 0.03707146644592285 length of segment : 1332 time for calcul the mask position with numpy : 0.004042387008666992 nb_pixel_total : 62365 time to create 1 rle with old method : 0.06498098373413086 length of segment : 272 time for calcul the mask position with numpy : 0.0006139278411865234 nb_pixel_total : 26690 time to create 1 rle with old method : 0.028230905532836914 length of segment : 188 time for calcul the mask position with numpy : 0.0031604766845703125 nb_pixel_total : 57423 time to create 1 rle with old method : 0.06295418739318848 length of segment : 385 time for calcul the mask position with numpy : 0.006510257720947266 nb_pixel_total : 120242 time to create 1 rle with old method : 0.1265559196472168 length of segment : 371 time for calcul the mask position with numpy : 0.003054380416870117 nb_pixel_total : 32718 time to create 1 rle with old method : 0.03346610069274902 length of segment : 329 time for calcul the mask position with numpy : 0.0038013458251953125 nb_pixel_total : 54105 time to create 1 rle with old method : 0.05658864974975586 length of segment : 405 time for calcul the mask position with numpy : 0.0032546520233154297 nb_pixel_total : 38588 time to create 1 rle with old method : 0.047483205795288086 length of segment : 269 time for calcul the mask position with numpy : 0.0003676414489746094 nb_pixel_total : 9025 time to create 1 rle with old method : 0.010337352752685547 length of segment : 84 time for calcul the mask position with numpy : 0.0037391185760498047 nb_pixel_total : 68623 time to create 1 rle with old method : 0.07680082321166992 length of segment : 335 time for calcul the mask position with numpy : 0.0010781288146972656 nb_pixel_total : 52936 time to create 1 rle with old method : 0.05704498291015625 length of segment : 366 time for calcul the mask position with numpy : 0.00098419189453125 nb_pixel_total : 12084 time to create 1 rle with old method : 0.013872146606445312 length of segment : 119 time for calcul the mask position with numpy : 0.004139423370361328 nb_pixel_total : 91519 time to create 1 rle with old method : 0.0967862606048584 length of segment : 370 time for calcul the mask position with numpy : 0.009358882904052734 nb_pixel_total : 169553 time to create 1 rle with new method : 0.012265443801879883 length of segment : 469 time for calcul the mask position with numpy : 0.020242691040039062 nb_pixel_total : 217622 time to create 1 rle with new method : 0.11365747451782227 length of segment : 625 time for calcul the mask position with numpy : 0.0006558895111083984 nb_pixel_total : 30425 time to create 1 rle with old method : 0.03110218048095703 length of segment : 194 time for calcul the mask position with numpy : 0.0019409656524658203 nb_pixel_total : 30076 time to create 1 rle with old method : 0.031127214431762695 length of segment : 201 time for calcul the mask position with numpy : 0.00240325927734375 nb_pixel_total : 40739 time to create 1 rle with old method : 0.04602408409118652 length of segment : 150 time for calcul the mask position with numpy : 0.002287626266479492 nb_pixel_total : 44019 time to create 1 rle with old method : 0.04537320137023926 length of segment : 251 time for calcul the mask position with numpy : 0.0014183521270751953 nb_pixel_total : 43829 time to create 1 rle with old method : 0.04767155647277832 length of segment : 177 time for calcul the mask position with numpy : 0.004984855651855469 nb_pixel_total : 71435 time to create 1 rle with old method : 0.0751192569732666 length of segment : 505 time for calcul the mask position with numpy : 0.020725488662719727 nb_pixel_total : 313221 time to create 1 rle with new method : 0.03360700607299805 length of segment : 725 time for calcul the mask position with numpy : 0.019690990447998047 nb_pixel_total : 512403 time to create 1 rle with new method : 0.02999091148376465 length of segment : 850 time for calcul the mask position with numpy : 0.0174405574798584 nb_pixel_total : 260222 time to create 1 rle with new method : 0.027687788009643555 length of segment : 768 time for calcul the mask position with numpy : 0.0017342567443847656 nb_pixel_total : 28539 time to create 1 rle with old method : 0.029245853424072266 length of segment : 257 time for calcul the mask position with numpy : 0.019331932067871094 nb_pixel_total : 442109 time to create 1 rle with new method : 0.03160667419433594 length of segment : 708 time for calcul the mask position with numpy : 0.0032296180725097656 nb_pixel_total : 55176 time to create 1 rle with old method : 0.0588536262512207 length of segment : 324 time for calcul the mask position with numpy : 0.016057729721069336 nb_pixel_total : 335432 time to create 1 rle with new method : 0.10034656524658203 length of segment : 1172 time for calcul the mask position with numpy : 0.011258602142333984 nb_pixel_total : 296783 time to create 1 rle with new method : 0.0220949649810791 length of segment : 824 time for calcul the mask position with numpy : 0.0024662017822265625 nb_pixel_total : 60605 time to create 1 rle with old method : 0.0649557113647461 length of segment : 190 time for calcul the mask position with numpy : 0.005072116851806641 nb_pixel_total : 134565 time to create 1 rle with old method : 0.15057921409606934 length of segment : 366 time for calcul the mask position with numpy : 0.0013933181762695312 nb_pixel_total : 18699 time to create 1 rle with old method : 0.020356416702270508 length of segment : 127 time for calcul the mask position with numpy : 0.014656782150268555 nb_pixel_total : 469074 time to create 1 rle with new method : 0.03014063835144043 length of segment : 960 time for calcul the mask position with numpy : 0.0005567073822021484 nb_pixel_total : 22096 time to create 1 rle with old method : 0.02303791046142578 length of segment : 161 time for calcul the mask position with numpy : 0.0036225318908691406 nb_pixel_total : 76190 time to create 1 rle with old method : 0.08395648002624512 length of segment : 302 time for calcul the mask position with numpy : 0.01658463478088379 nb_pixel_total : 432544 time to create 1 rle with new method : 0.034813642501831055 length of segment : 708 time for calcul the mask position with numpy : 0.002415180206298828 nb_pixel_total : 51713 time to create 1 rle with old method : 0.05513143539428711 length of segment : 284 time for calcul the mask position with numpy : 0.0013892650604248047 nb_pixel_total : 19642 time to create 1 rle with old method : 0.02122974395751953 length of segment : 181 time for calcul the mask position with numpy : 0.004807472229003906 nb_pixel_total : 56661 time to create 1 rle with old method : 0.0747520923614502 length of segment : 342 time for calcul the mask position with numpy : 0.008829593658447266 nb_pixel_total : 366898 time to create 1 rle with new method : 0.02583479881286621 length of segment : 771 time for calcul the mask position with numpy : 0.012143611907958984 nb_pixel_total : 179155 time to create 1 rle with new method : 0.01682567596435547 length of segment : 349 time for calcul the mask position with numpy : 0.0016450881958007812 nb_pixel_total : 38748 time to create 1 rle with old method : 0.043422698974609375 length of segment : 209 time for calcul the mask position with numpy : 0.0018193721771240234 nb_pixel_total : 30610 time to create 1 rle with old method : 0.03276562690734863 length of segment : 183 time for calcul the mask position with numpy : 0.0017919540405273438 nb_pixel_total : 55115 time to create 1 rle with old method : 0.0572056770324707 length of segment : 263 time for calcul the mask position with numpy : 0.008600950241088867 nb_pixel_total : 162313 time to create 1 rle with new method : 0.017476797103881836 length of segment : 509 time for calcul the mask position with numpy : 0.004647731781005859 nb_pixel_total : 49990 time to create 1 rle with old method : 0.05417823791503906 length of segment : 360 time for calcul the mask position with numpy : 0.0008635520935058594 nb_pixel_total : 45338 time to create 1 rle with old method : 0.04792332649230957 length of segment : 137 time for calcul the mask position with numpy : 0.002897500991821289 nb_pixel_total : 58131 time to create 1 rle with old method : 0.06385684013366699 length of segment : 250 time for calcul the mask position with numpy : 0.002232074737548828 nb_pixel_total : 63336 time to create 1 rle with old method : 0.07001042366027832 length of segment : 351 time for calcul the mask position with numpy : 0.0008311271667480469 nb_pixel_total : 19495 time to create 1 rle with old method : 0.022615432739257812 length of segment : 228 time for calcul the mask position with numpy : 0.00512242317199707 nb_pixel_total : 30182 time to create 1 rle with old method : 0.03390908241271973 length of segment : 521 time for calcul the mask position with numpy : 0.004462242126464844 nb_pixel_total : 77262 time to create 1 rle with old method : 0.0924680233001709 length of segment : 312 time for calcul the mask position with numpy : 0.004333972930908203 nb_pixel_total : 71820 time to create 1 rle with old method : 0.07988190650939941 length of segment : 384 time for calcul the mask position with numpy : 0.0013988018035888672 nb_pixel_total : 36934 time to create 1 rle with old method : 0.038637638092041016 length of segment : 310 time for calcul the mask position with numpy : 0.0016553401947021484 nb_pixel_total : 22501 time to create 1 rle with old method : 0.024720430374145508 length of segment : 154 time for calcul the mask position with numpy : 0.0020329952239990234 nb_pixel_total : 65704 time to create 1 rle with old method : 0.06653428077697754 length of segment : 360 time for calcul the mask position with numpy : 0.00015354156494140625 nb_pixel_total : 4526 time to create 1 rle with old method : 0.004886627197265625 length of segment : 139 time for calcul the mask position with numpy : 0.0009450912475585938 nb_pixel_total : 46539 time to create 1 rle with old method : 0.04764151573181152 length of segment : 328 time for calcul the mask position with numpy : 0.0009019374847412109 nb_pixel_total : 44536 time to create 1 rle with old method : 0.048642873764038086 length of segment : 265 time for calcul the mask position with numpy : 0.002506732940673828 nb_pixel_total : 37326 time to create 1 rle with old method : 0.039011240005493164 length of segment : 274 time for calcul the mask position with numpy : 0.0005400180816650391 nb_pixel_total : 25927 time to create 1 rle with old method : 0.027272939682006836 length of segment : 110 time for calcul the mask position with numpy : 0.0027201175689697266 nb_pixel_total : 49542 time to create 1 rle with old method : 0.05025362968444824 length of segment : 340 time for calcul the mask position with numpy : 0.017600536346435547 nb_pixel_total : 423010 time to create 1 rle with new method : 0.02029585838317871 length of segment : 584 time for calcul the mask position with numpy : 0.025382518768310547 nb_pixel_total : 433401 time to create 1 rle with new method : 0.024759292602539062 length of segment : 751 time for calcul the mask position with numpy : 0.020505428314208984 nb_pixel_total : 472984 time to create 1 rle with new method : 0.06119346618652344 length of segment : 1055 time for calcul the mask position with numpy : 0.008744001388549805 nb_pixel_total : 86832 time to create 1 rle with old method : 0.09299159049987793 length of segment : 429 time for calcul the mask position with numpy : 0.012782096862792969 nb_pixel_total : 250404 time to create 1 rle with new method : 0.015269279479980469 length of segment : 902 time for calcul the mask position with numpy : 0.0025064945220947266 nb_pixel_total : 64894 time to create 1 rle with old method : 0.0668942928314209 length of segment : 434 time for calcul the mask position with numpy : 0.0017635822296142578 nb_pixel_total : 35842 time to create 1 rle with old method : 0.0369105339050293 length of segment : 251 time for calcul the mask position with numpy : 0.003361225128173828 nb_pixel_total : 54823 time to create 1 rle with old method : 0.059507131576538086 length of segment : 254 time for calcul the mask position with numpy : 0.003100156784057617 nb_pixel_total : 55921 time to create 1 rle with old method : 0.056344032287597656 length of segment : 307 time for calcul the mask position with numpy : 0.0011398792266845703 nb_pixel_total : 23581 time to create 1 rle with old method : 0.02455735206604004 length of segment : 153 time for calcul the mask position with numpy : 0.012751579284667969 nb_pixel_total : 245752 time to create 1 rle with new method : 0.014783382415771484 length of segment : 1005 time for calcul the mask position with numpy : 0.006902456283569336 nb_pixel_total : 130865 time to create 1 rle with old method : 0.13885974884033203 length of segment : 533 time for calcul the mask position with numpy : 0.002931833267211914 nb_pixel_total : 40276 time to create 1 rle with old method : 0.041739702224731445 length of segment : 179 time for calcul the mask position with numpy : 0.0001952648162841797 nb_pixel_total : 5024 time to create 1 rle with old method : 0.005604267120361328 length of segment : 54 time for calcul the mask position with numpy : 0.0021927356719970703 nb_pixel_total : 43420 time to create 1 rle with old method : 0.04738783836364746 length of segment : 198 time for calcul the mask position with numpy : 0.0015828609466552734 nb_pixel_total : 56123 time to create 1 rle with old method : 0.0572361946105957 length of segment : 422 time for calcul the mask position with numpy : 0.018107891082763672 nb_pixel_total : 193684 time to create 1 rle with new method : 0.024770021438598633 length of segment : 551 time for calcul the mask position with numpy : 0.006186485290527344 nb_pixel_total : 122993 time to create 1 rle with old method : 0.13191461563110352 length of segment : 634 time for calcul the mask position with numpy : 0.004442930221557617 nb_pixel_total : 85784 time to create 1 rle with old method : 0.09297394752502441 length of segment : 534 time for calcul the mask position with numpy : 0.0005655288696289062 nb_pixel_total : 9210 time to create 1 rle with old method : 0.010473489761352539 length of segment : 93 time for calcul the mask position with numpy : 0.0027391910552978516 nb_pixel_total : 55634 time to create 1 rle with old method : 0.05900979042053223 length of segment : 271 time for calcul the mask position with numpy : 0.0006325244903564453 nb_pixel_total : 10521 time to create 1 rle with old method : 0.012318134307861328 length of segment : 73 time for calcul the mask position with numpy : 0.0012314319610595703 nb_pixel_total : 19814 time to create 1 rle with old method : 0.021352767944335938 length of segment : 164 time for calcul the mask position with numpy : 0.0030677318572998047 nb_pixel_total : 64171 time to create 1 rle with old method : 0.06766152381896973 length of segment : 300 time for calcul the mask position with numpy : 0.0006046295166015625 nb_pixel_total : 14205 time to create 1 rle with old method : 0.015490055084228516 length of segment : 100 time for calcul the mask position with numpy : 0.0033922195434570312 nb_pixel_total : 75763 time to create 1 rle with old method : 0.08101248741149902 length of segment : 296 time for calcul the mask position with numpy : 0.0039052963256835938 nb_pixel_total : 68720 time to create 1 rle with old method : 0.07431983947753906 length of segment : 359 time for calcul the mask position with numpy : 0.0008974075317382812 nb_pixel_total : 20937 time to create 1 rle with old method : 0.022197961807250977 length of segment : 203 time for calcul the mask position with numpy : 0.0018651485443115234 nb_pixel_total : 41783 time to create 1 rle with old method : 0.0436856746673584 length of segment : 404 time for calcul the mask position with numpy : 0.00035643577575683594 nb_pixel_total : 14078 time to create 1 rle with old method : 0.015337705612182617 length of segment : 148 time for calcul the mask position with numpy : 0.0010557174682617188 nb_pixel_total : 14659 time to create 1 rle with old method : 0.015703916549682617 length of segment : 129 time for calcul the mask position with numpy : 0.00022840499877929688 nb_pixel_total : 12565 time to create 1 rle with old method : 0.013163328170776367 length of segment : 119 time for calcul the mask position with numpy : 0.0014886856079101562 nb_pixel_total : 58751 time to create 1 rle with old method : 0.060163259506225586 length of segment : 333 time for calcul the mask position with numpy : 0.016403913497924805 nb_pixel_total : 406103 time to create 1 rle with new method : 0.027738332748413086 length of segment : 782 time for calcul the mask position with numpy : 0.01670074462890625 nb_pixel_total : 394904 time to create 1 rle with new method : 0.027924537658691406 length of segment : 656 time for calcul the mask position with numpy : 0.0046732425689697266 nb_pixel_total : 57666 time to create 1 rle with old method : 0.06363558769226074 length of segment : 246 time for calcul the mask position with numpy : 0.018462419509887695 nb_pixel_total : 461065 time to create 1 rle with new method : 0.030432701110839844 length of segment : 1522 time for calcul the mask position with numpy : 0.013604164123535156 nb_pixel_total : 360695 time to create 1 rle with new method : 0.025386571884155273 length of segment : 829 time for calcul the mask position with numpy : 0.0024192333221435547 nb_pixel_total : 54462 time to create 1 rle with old method : 0.05661630630493164 length of segment : 239 time for calcul the mask position with numpy : 0.0038564205169677734 nb_pixel_total : 43628 time to create 1 rle with old method : 0.04446077346801758 length of segment : 386 time for calcul the mask position with numpy : 0.003909587860107422 nb_pixel_total : 78156 time to create 1 rle with old method : 0.08346080780029297 length of segment : 278 time for calcul the mask position with numpy : 0.0021114349365234375 nb_pixel_total : 41196 time to create 1 rle with old method : 0.04547619819641113 length of segment : 226 time for calcul the mask position with numpy : 0.00157928466796875 nb_pixel_total : 26272 time to create 1 rle with old method : 0.0273895263671875 length of segment : 215 time for calcul the mask position with numpy : 0.0014848709106445312 nb_pixel_total : 30420 time to create 1 rle with old method : 0.031185150146484375 length of segment : 241 time for calcul the mask position with numpy : 0.0013647079467773438 nb_pixel_total : 57131 time to create 1 rle with old method : 0.05849123001098633 length of segment : 522 time for calcul the mask position with numpy : 0.004544734954833984 nb_pixel_total : 94603 time to create 1 rle with old method : 0.09556961059570312 length of segment : 411 time for calcul the mask position with numpy : 0.0014526844024658203 nb_pixel_total : 24442 time to create 1 rle with old method : 0.02516651153564453 length of segment : 346 time for calcul the mask position with numpy : 0.001129150390625 nb_pixel_total : 20362 time to create 1 rle with old method : 0.021378040313720703 length of segment : 147 time for calcul the mask position with numpy : 0.0016531944274902344 nb_pixel_total : 30206 time to create 1 rle with old method : 0.032885074615478516 length of segment : 239 time for calcul the mask position with numpy : 0.0033156871795654297 nb_pixel_total : 65667 time to create 1 rle with old method : 0.06783294677734375 length of segment : 263 time for calcul the mask position with numpy : 0.003319263458251953 nb_pixel_total : 56035 time to create 1 rle with old method : 0.06031322479248047 length of segment : 270 time for calcul the mask position with numpy : 0.015934467315673828 nb_pixel_total : 139618 time to create 1 rle with old method : 0.1496422290802002 length of segment : 835 time for calcul the mask position with numpy : 0.017287015914916992 nb_pixel_total : 416412 time to create 1 rle with new method : 0.12178540229797363 length of segment : 821 time for calcul the mask position with numpy : 0.0026214122772216797 nb_pixel_total : 59268 time to create 1 rle with old method : 0.06242990493774414 length of segment : 310 time for calcul the mask position with numpy : 0.0008947849273681641 nb_pixel_total : 51577 time to create 1 rle with old method : 0.05501270294189453 length of segment : 243 time for calcul the mask position with numpy : 0.000982046127319336 nb_pixel_total : 26786 time to create 1 rle with old method : 0.02907085418701172 length of segment : 175 time for calcul the mask position with numpy : 0.001505136489868164 nb_pixel_total : 65655 time to create 1 rle with old method : 0.0683896541595459 length of segment : 265 time for calcul the mask position with numpy : 0.002484560012817383 nb_pixel_total : 106065 time to create 1 rle with old method : 0.11121273040771484 length of segment : 262 time for calcul the mask position with numpy : 0.002362489700317383 nb_pixel_total : 60702 time to create 1 rle with old method : 0.06364154815673828 length of segment : 468 time for calcul the mask position with numpy : 0.0012052059173583984 nb_pixel_total : 38914 time to create 1 rle with old method : 0.03992772102355957 length of segment : 248 time for calcul the mask position with numpy : 0.0015442371368408203 nb_pixel_total : 24917 time to create 1 rle with old method : 0.025345563888549805 length of segment : 235 time for calcul the mask position with numpy : 0.0031328201293945312 nb_pixel_total : 73210 time to create 1 rle with old method : 0.07744717597961426 length of segment : 232 time for calcul the mask position with numpy : 0.008848428726196289 nb_pixel_total : 118819 time to create 1 rle with old method : 0.11876821517944336 length of segment : 864 time for calcul the mask position with numpy : 0.0011887550354003906 nb_pixel_total : 66395 time to create 1 rle with old method : 0.06936168670654297 length of segment : 232 time for calcul the mask position with numpy : 0.0019378662109375 nb_pixel_total : 54350 time to create 1 rle with old method : 0.05657529830932617 length of segment : 323 time for calcul the mask position with numpy : 0.00017118453979492188 nb_pixel_total : 7387 time to create 1 rle with old method : 0.007700681686401367 length of segment : 113 time for calcul the mask position with numpy : 0.00732874870300293 nb_pixel_total : 145827 time to create 1 rle with old method : 0.15059328079223633 length of segment : 465 time for calcul the mask position with numpy : 0.0016963481903076172 nb_pixel_total : 36837 time to create 1 rle with old method : 0.0374758243560791 length of segment : 252 time for calcul the mask position with numpy : 0.0007827281951904297 nb_pixel_total : 22320 time to create 1 rle with old method : 0.02425074577331543 length of segment : 222 time for calcul the mask position with numpy : 0.002315521240234375 nb_pixel_total : 36266 time to create 1 rle with old method : 0.03745627403259277 length of segment : 278 time for calcul the mask position with numpy : 0.002429962158203125 nb_pixel_total : 54427 time to create 1 rle with old method : 0.05575370788574219 length of segment : 233 time for calcul the mask position with numpy : 0.016706228256225586 nb_pixel_total : 420080 time to create 1 rle with new method : 0.025597572326660156 length of segment : 630 time for calcul the mask position with numpy : 0.004513740539550781 nb_pixel_total : 79375 time to create 1 rle with old method : 0.08602476119995117 length of segment : 339 time for calcul the mask position with numpy : 0.017777442932128906 nb_pixel_total : 382696 time to create 1 rle with new method : 0.025873899459838867 length of segment : 749 time for calcul the mask position with numpy : 0.007924556732177734 nb_pixel_total : 115634 time to create 1 rle with old method : 0.11920619010925293 length of segment : 599 time for calcul the mask position with numpy : 0.001645803451538086 nb_pixel_total : 31469 time to create 1 rle with old method : 0.03360915184020996 length of segment : 206 time for calcul the mask position with numpy : 0.017854690551757812 nb_pixel_total : 327101 time to create 1 rle with new method : 0.02751779556274414 length of segment : 1401 time for calcul the mask position with numpy : 0.01671004295349121 nb_pixel_total : 427330 time to create 1 rle with new method : 0.0247652530670166 length of segment : 812 time for calcul the mask position with numpy : 0.002843141555786133 nb_pixel_total : 53860 time to create 1 rle with old method : 0.055817365646362305 length of segment : 200 time for calcul the mask position with numpy : 0.00466156005859375 nb_pixel_total : 133267 time to create 1 rle with old method : 0.14798307418823242 length of segment : 568 time for calcul the mask position with numpy : 0.008981704711914062 nb_pixel_total : 110801 time to create 1 rle with old method : 0.1218559741973877 length of segment : 813 time for calcul the mask position with numpy : 0.008755683898925781 nb_pixel_total : 146876 time to create 1 rle with old method : 0.1519789695739746 length of segment : 439 time for calcul the mask position with numpy : 0.0009691715240478516 nb_pixel_total : 45190 time to create 1 rle with old method : 0.04675793647766113 length of segment : 288 time for calcul the mask position with numpy : 0.0072515010833740234 nb_pixel_total : 118102 time to create 1 rle with old method : 0.12540411949157715 length of segment : 431 time for calcul the mask position with numpy : 0.0031213760375976562 nb_pixel_total : 43597 time to create 1 rle with old method : 0.045510292053222656 length of segment : 275 time for calcul the mask position with numpy : 0.0015327930450439453 nb_pixel_total : 36983 time to create 1 rle with old method : 0.04005074501037598 length of segment : 204 time for calcul the mask position with numpy : 0.0015292167663574219 nb_pixel_total : 46475 time to create 1 rle with old method : 0.04818129539489746 length of segment : 498 time for calcul the mask position with numpy : 0.0005197525024414062 nb_pixel_total : 26516 time to create 1 rle with old method : 0.028094768524169922 length of segment : 167 time for calcul the mask position with numpy : 0.0019154548645019531 nb_pixel_total : 25918 time to create 1 rle with old method : 0.026741504669189453 length of segment : 234 time for calcul the mask position with numpy : 0.002138853073120117 nb_pixel_total : 50082 time to create 1 rle with old method : 0.054430246353149414 length of segment : 306 time for calcul the mask position with numpy : 0.0017731189727783203 nb_pixel_total : 40169 time to create 1 rle with old method : 0.04377174377441406 length of segment : 257 time for calcul the mask position with numpy : 0.0020956993103027344 nb_pixel_total : 37109 time to create 1 rle with old method : 0.041240692138671875 length of segment : 224 time for calcul the mask position with numpy : 0.006407499313354492 nb_pixel_total : 103899 time to create 1 rle with old method : 0.10808539390563965 length of segment : 630 time for calcul the mask position with numpy : 0.0021009445190429688 nb_pixel_total : 68654 time to create 1 rle with old method : 0.07175111770629883 length of segment : 237 time for calcul the mask position with numpy : 0.0003790855407714844 nb_pixel_total : 15229 time to create 1 rle with old method : 0.01634836196899414 length of segment : 133 time for calcul the mask position with numpy : 0.00267791748046875 nb_pixel_total : 44922 time to create 1 rle with old method : 0.04708671569824219 length of segment : 305 time for calcul the mask position with numpy : 0.0030090808868408203 nb_pixel_total : 41013 time to create 1 rle with old method : 0.04496479034423828 length of segment : 288 time for calcul the mask position with numpy : 0.0009260177612304688 nb_pixel_total : 31780 time to create 1 rle with old method : 0.03288578987121582 length of segment : 263 time for calcul the mask position with numpy : 0.0032911300659179688 nb_pixel_total : 89661 time to create 1 rle with old method : 0.09253621101379395 length of segment : 482 time spent for convertir_results : 42.7982234954834 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 358 chid ids of type : 3760 Number RLEs to save : 147291 save missing photos in datou_result : time spend for datou_step_exec : 167.65050411224365 time spend to save output : 14.811863422393799 total time spend for step 1 : 182.46236753463745 step2:blur_detection Sat Feb 1 07:37:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3.jpg resize: (2160, 3840) 1333211566 -5.344207340329601 treat image : temp/1738391668_3674520_1333211559_3b126c04aad80924e81b5816ecd4d5b1.jpg resize: (2160, 3840) 1333211559 -3.076831041716178 treat image : temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313.jpg resize: (2160, 3840) 1333211553 -5.226019639275802 treat image : temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed.jpg resize: (2160, 3840) 1333211539 -5.184819310063557 treat image : temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549.jpg resize: (2160, 3840) 1333211511 -4.606382681937619 treat image : temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606.jpg resize: (2160, 3840) 1333211507 -5.416588196015146 treat image : temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4.jpg resize: (2160, 3840) 1333211502 -5.010817445230512 treat image : temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01.jpg resize: (2160, 3840) 1333211499 -5.195382579984201 treat image : temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167.jpg resize: (2160, 3840) 1333211467 -5.216023207989471 treat image : temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6.jpg resize: (2160, 3840) 1333211400 -5.192312048549492 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 10 time used for this insertion : 0.012681007385253906 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 10 time used for this insertion : 0.011934280395507812 save missing photos in datou_result : time spend for datou_step_exec : 39.89583873748779 time spend to save output : 0.03000354766845703 total time spend for step 2 : 39.92584228515625 step3:brightness Sat Feb 1 07:38:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3.jpg treat image : temp/1738391668_3674520_1333211559_3b126c04aad80924e81b5816ecd4d5b1.jpg treat image : temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313.jpg treat image : temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed.jpg treat image : temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549.jpg treat image : temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606.jpg treat image : temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4.jpg treat image : temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01.jpg treat image : temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167.jpg treat image : temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 10 time used for this insertion : 0.013233184814453125 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 10 time used for this insertion : 0.011992454528808594 save missing photos in datou_result : time spend for datou_step_exec : 9.669548511505127 time spend to save output : 0.030768632888793945 total time spend for step 3 : 9.700317144393921 step4:crop_condition Sat Feb 1 07:38:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3760 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 358 chid ids of type : 3760 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : barquette param for this class : {'min_score': 0.7} filtre for class : barquette hashtag_id of this class : 492787675 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 64 About to insert : list_path_to_insert length 64 new photo from crops ! About to upload 64 photos upload in portfolio : 4219792 init cache_photo without model_param we have 64 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738391929_3674520 we have uploaded 64 photos in the portfolio 4219792 time of upload the photos Elapsed time : 16.11835551261902 we have finished the crop for the class : barquette begin to crop the class : fibreux_cont param for this class : {'min_score': 0.7} filtre for class : fibreux_cont hashtag_id of this class : 2107756748 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 20 About to insert : list_path_to_insert length 20 new photo from crops ! About to upload 20 photos upload in portfolio : 4219792 init cache_photo without model_param we have 20 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738391949_3674520 we have uploaded 20 photos in the portfolio 4219792 time of upload the photos Elapsed time : 7.019365310668945 we have finished the crop for the class : fibreux_cont begin to crop the class : film_plastique param for this class : {'min_score': 0.7} filtre for class : film_plastique hashtag_id of this class : 2107756122 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 35 About to insert : list_path_to_insert length 35 new photo from crops ! About to upload 35 photos upload in portfolio : 4219792 init cache_photo without model_param we have 35 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738391967_3674520 we have uploaded 35 photos in the portfolio 4219792 time of upload the photos Elapsed time : 9.160879850387573 we have finished the crop for the class : film_plastique begin to crop the class : autre_contaminant param for this class : {'min_score': 0.7} filtre for class : autre_contaminant hashtag_id of this class : 2107756781 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 4219792 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738391983_3674520 we have uploaded 29 photos in the portfolio 4219792 time of upload the photos Elapsed time : 6.660917043685913 we have finished the crop for the class : autre_contaminant begin to crop the class : etiquette_detachee param for this class : {'min_score': 0.7} filtre for class : etiquette_detachee hashtag_id of this class : 2107756860 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 4219792 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738391994_3674520 we have uploaded 13 photos in the portfolio 4219792 time of upload the photos Elapsed time : 3.098466634750366 we have finished the crop for the class : etiquette_detachee begin to crop the class : pet_clair_cont param for this class : {'min_score': 0.7} filtre for class : pet_clair_cont hashtag_id of this class : 2107758154 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 66 About to insert : list_path_to_insert length 66 new photo from crops ! About to upload 66 photos upload in portfolio : 4219792 init cache_photo without model_param we have 66 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738392011_3674520 we have uploaded 66 photos in the portfolio 4219792 time of upload the photos Elapsed time : 18.171072006225586 we have finished the crop for the class : pet_clair_cont begin to crop the class : metal_cont param for this class : {'min_score': 0.7} filtre for class : metal_cont hashtag_id of this class : 2107756749 begin to crop the class : pet_fonce_cont param for this class : {'min_score': 0.7} filtre for class : pet_fonce_cont hashtag_id of this class : 2107758155 begin to crop the class : pet_opaque_cont param for this class : {'min_score': 0.7} filtre for class : pet_opaque_cont hashtag_id of this class : 2107758156 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 27 About to insert : list_path_to_insert length 27 new photo from crops ! About to upload 27 photos upload in portfolio : 4219792 init cache_photo without model_param we have 27 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738392039_3674520 we have uploaded 27 photos in the portfolio 4219792 time of upload the photos Elapsed time : 7.192082405090332 we have finished the crop for the class : pet_opaque_cont delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1333211566, 1333211559, 1333211553, 1333211539, 1333211511, 1333211507, 1333211502, 1333211499, 1333211467, 1333211400] Looping around the photos to save general results len do output : 254 /1333630275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333630999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333631180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211566', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211559', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211553', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211539', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211511', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211507', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211502', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211499', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211467', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211400', None, None, None, None, None, '2532921') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 772 time used for this insertion : 0.0739583969116211 save_final save missing photos in datou_result : time spend for datou_step_exec : 148.4744372367859 time spend to save output : 0.07956910133361816 total time spend for step 4 : 148.5540063381195 step5:thcl Sat Feb 1 07:40:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3233 time to import caffe and check if the image exist : 0.029597759246826172 time to convert the images to numpy array : 0.5959293842315674 time to import caffe and check if the image exist : 0.012412548065185547 time to convert the images to numpy array : 0.6209867000579834 time to import caffe and check if the image exist : 0.013273477554321289 time to convert the images to numpy array : 0.6325445175170898 time to import caffe and check if the image exist : 0.03899669647216797 time to convert the images to numpy array : 0.6142511367797852 time to import caffe and check if the image exist : 0.056966543197631836 time to convert the images to numpy array : 0.5983715057373047 time to import caffe and check if the image exist : 0.02785325050354004 time to convert the images to numpy array : 0.6371352672576904 time to import caffe and check if the image exist : 0.030652284622192383 time to convert the images to numpy array : 0.6434712409973145 time to import caffe and check if the image exist : 0.023988723754882812 time to convert the images to numpy array : 0.6514062881469727 time to import caffe and check if the image exist : 0.05389714241027832 time to convert the images to numpy array : 0.6589727401733398 time to import caffe and check if the image exist : 0.03913760185241699 time to convert the images to numpy array : 0.7174196243286133 total time to convert the images to numpy array : 0.9663376808166504 list photo_ids error: [] list photo_ids correct : [1333630754, 1333630756, 1333630758, 1333630761, 1333630762, 1333630764, 1333630766, 1333630768, 1333630770, 1333630772, 1333630775, 1333630777, 1333630779, 1333630781, 1333630783, 1333630785, 1333630787, 1333630789, 1333630901, 1333630902, 1333630903, 1333630904, 1333630905, 1333630906, 1333630907, 1333630908, 1333631160, 1333631161, 1333631162, 1333631163, 1333631164, 1333631165, 1333631166, 1333631167, 1333631168, 1333631169, 1333631170, 1333631171, 1333631172, 1333631173, 1333631174, 1333631175, 1333631177, 1333631178, 1333631179, 1333631180, 1333630986, 1333630987, 1333630988, 1333630989, 1333630990, 1333630991, 1333630992, 1333630993, 1333630994, 1333630995, 1333630996, 1333630997, 1333630998, 1333630999, 1333631000, 1333631001, 1333631002, 1333631003, 1333631004, 1333631005, 1333631006, 1333631007, 1333631008, 1333631009, 1333631010, 1333631011, 1333630909, 1333630910, 1333630911, 1333630912, 1333630913, 1333630965, 1333630966, 1333630967, 1333630968, 1333630969, 1333630970, 1333630971, 1333630972, 1333630973, 1333630974, 1333630975, 1333630976, 1333630977, 1333630978, 1333630979, 1333630980, 1333630981, 1333630982, 1333630983, 1333630984, 1333630985, 1333630377, 1333630379, 1333630381, 1333630383, 1333630385, 1333630387, 1333630389, 1333630390, 1333630392, 1333630394, 1333630395, 1333630399, 1333630525, 1333630527, 1333630529, 1333630531, 1333630532, 1333630533, 1333630534, 1333630537, 1333630539, 1333630541, 1333630543, 1333630545, 1333630548, 1333630550, 1333631013, 1333631014, 1333631015, 1333631016, 1333631017, 1333631018, 1333631019, 1333631020, 1333631021, 1333631022, 1333631023, 1333631024, 1333631025, 1333631026, 1333631027, 1333631028, 1333631029, 1333631030, 1333631031, 1333631153, 1333631154, 1333631155, 1333631156, 1333631157, 1333631158, 1333631159, 1333630552, 1333630554, 1333630556, 1333630559, 1333630565, 1333630567, 1333630688, 1333630689, 1333630690, 1333630691, 1333630692, 1333630693, 1333630694, 1333630695, 1333630696, 1333630697, 1333630698, 1333630699, 1333630700, 1333630702, 1333630703, 1333630705, 1333630706, 1333630707, 1333630708, 1333630709, 1333630710, 1333630711, 1333630712, 1333630713, 1333630714, 1333630715, 1333630716, 1333630717, 1333630718, 1333630719, 1333630720, 1333630721, 1333630722, 1333630723, 1333630724, 1333630737, 1333630738, 1333630739, 1333630740, 1333630741, 1333630742, 1333630743, 1333630745, 1333630748, 1333630750, 1333630752, 1333630323, 1333630325, 1333630327, 1333630329, 1333630331, 1333630333, 1333630335, 1333630337, 1333630341, 1333630343, 1333630344, 1333630346, 1333630349, 1333630354, 1333630356, 1333630358, 1333630359, 1333630361, 1333630363, 1333630365, 1333630367, 1333630370, 1333630372, 1333630374, 1333630375, 1333630376, 1333630275, 1333630278, 1333630282, 1333630284, 1333630286, 1333630288, 1333630289, 1333630290, 1333630292, 1333630294, 1333630296, 1333630297, 1333630299, 1333630301, 1333630303, 1333630305, 1333630307, 1333630309, 1333630311, 1333630312, 1333630313, 1333630315, 1333630317, 1333630318, 1333630320, 1333630321] number of photos to traite : 254 try to delete the photos incorrect in DB tagging for thcl : 3233 To do loadFromThcl(), then load ParamDescType : thcl3233 thcls : [{'id': 3233, 'mtr_user_id': 31, 'name': 'learn_generique_01122021_6000_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'barquette_opaque,carton,ela,environnement,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_fonce,pet_opaque,textiles_sanitaires', 'svm_portfolios_learning': '4825680,4829009,4825557,4824709,4824714,4824733,4825676,4824737,4824753,4829002,4824848,4824863,4825667,4825677', 'photo_hashtag_type': 4151, 'photo_desc_type': 5557, 'type_classification': 'caffe', 'hashtag_id_list': '2107760128,492774966,492741797,493012381,492636447,2107756122,493202403,492628673,492668766,628944319,2107755846,2107755900,2107759152,2107760129'}] thcl {'id': 3233, 'mtr_user_id': 31, 'name': 'learn_generique_01122021_6000_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'barquette_opaque,carton,ela,environnement,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_fonce,pet_opaque,textiles_sanitaires', 'svm_portfolios_learning': '4825680,4829009,4825557,4824709,4824714,4824733,4825676,4824737,4824753,4829002,4824848,4824863,4825667,4825677', 'photo_hashtag_type': 4151, 'photo_desc_type': 5557, 'type_classification': 'caffe', 'hashtag_id_list': '2107760128,492774966,492741797,493012381,492636447,2107756122,493202403,492628673,492668766,628944319,2107755846,2107755900,2107759152,2107760129'} Update svm_hashtag_type_desc : 5557 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5557, 'learn_generique_01122021_6000_v2', 2048, 2048, 'learn_generique_01122021_6000_v2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 1, 19, 59, 17), datetime.datetime(2021, 12, 1, 19, 59, 17)) To loadFromThcl() : net_5557 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 9969 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5557, 'learn_generique_01122021_6000_v2', 2048, 2048, 'learn_generique_01122021_6000_v2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 1, 19, 59, 17), datetime.datetime(2021, 12, 1, 19, 59, 17)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_generique_01122021_6000_v2 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_generique_01122021_6000_v2 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_generique_01122021_6000_v2 /data/models_weight/learn_generique_01122021_6000_v2/caffemodel size_local : 94383085 size in s3 : 94383085 create time local : 2021-12-09 17:03:46 create time in s3 : 2021-12-01 18:45:54 caffemodel already exist and didn't need to update /data/models_weight/learn_generique_01122021_6000_v2/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-09 17:03:46 create time in s3 : 2021-12-01 18:45:53 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_generique_01122021_6000_v2/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-09 17:03:47 create time in s3 : 2021-12-01 18:59:02 mean.npy already exist and didn't need to update /data/models_weight/learn_generique_01122021_6000_v2/synset_words.txt size_local : 454 size in s3 : 454 create time local : 2021-12-09 17:03:47 create time in s3 : 2021-12-01 18:59:15 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_generique_01122021_6000_v2/deploy.prototxt caffemodel_filename : /data/models_weight/learn_generique_01122021_6000_v2/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5266 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 2.0459823608398438 time used to do the prediction : 1.3470079898834229 save descriptor for thcl : 3233 time to traite the descriptors : 1.470935344696045 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1333630754 To insert : 1333630756 To insert : 1333630758 To insert : 1333630761 To insert : 1333630762 To insert : 1333630764 To insert : 1333630766 To insert : 1333630768 To insert : 1333630770 To insert : 1333630772 To insert : 1333630775 To insert : 1333630777 To insert : 1333630779 To insert : 1333630781 To insert : 1333630783 To insert : 1333630785 To insert : 1333630787 To insert : 1333630789 To insert : 1333630901 To insert : 1333630902 To insert : 1333630903 To insert : 1333630904 To insert : 1333630905 To insert : 1333630906 To insert : 1333630907 To insert : 1333630908 To insert : 1333631160 To insert : 1333631161 To insert : 1333631162 To insert : 1333631163 To insert : 1333631164 To insert : 1333631165 To insert : 1333631166 To insert : 1333631167 To insert : 1333631168 To insert : 1333631169 To insert : 1333631170 To insert : 1333631171 To insert : 1333631172 To insert : 1333631173 To insert : 1333631174 To insert : 1333631175 To insert : 1333631177 To insert : 1333631178 To insert : 1333631179 To insert : 1333631180 To insert : 1333630986 To insert : 1333630987 To insert : 1333630988 To insert : 1333630989 To insert : 1333630990 To insert : 1333630991 To insert : 1333630992 To insert : 1333630993 To insert : 1333630994 To insert : 1333630995 To insert : 1333630996 To insert : 1333630997 To insert : 1333630998 To insert : 1333630999 To insert : 1333631000 To insert : 1333631001 To insert : 1333631002 To insert : 1333631003 To insert : 1333631004 To insert : 1333631005 To insert : 1333631006 To insert : 1333631007 To insert : 1333631008 To insert : 1333631009 To insert : 1333631010 To insert : 1333631011 To insert : 1333630909 To insert : 1333630910 To insert : 1333630911 To insert : 1333630912 To insert : 1333630913 To insert : 1333630965 To insert : 1333630966 To insert : 1333630967 To insert : 1333630968 To insert : 1333630969 To insert : 1333630970 To insert : 1333630971 To insert : 1333630972 To insert : 1333630973 To insert : 1333630974 To insert : 1333630975 To insert : 1333630976 To insert : 1333630977 To insert : 1333630978 To insert : 1333630979 To insert : 1333630980 To insert : 1333630981 To insert : 1333630982 To insert : 1333630983 To insert : 1333630984 To insert : 1333630985 To insert : 1333630377 To insert : 1333630379 To insert : 1333630381 To insert : 1333630383 To insert : 1333630385 To insert : 1333630387 To insert : 1333630389 To insert : 1333630390 To insert : 1333630392 To insert : 1333630394 To insert : 1333630395 To insert : 1333630399 To insert : 1333630525 To insert : 1333630527 To insert : 1333630529 To insert : 1333630531 To insert : 1333630532 To insert : 1333630533 To insert : 1333630534 To insert : 1333630537 To insert : 1333630539 To insert : 1333630541 To insert : 1333630543 To insert : 1333630545 To insert : 1333630548 To insert : 1333630550 To insert : 1333631013 To insert : 1333631014 To insert : 1333631015 To insert : 1333631016 To insert : 1333631017 To insert : 1333631018 To insert : 1333631019 To insert : 1333631020 To insert : 1333631021 To insert : 1333631022 To insert : 1333631023 To insert : 1333631024 To insert : 1333631025 To insert : 1333631026 To insert : 1333631027 To insert : 1333631028 To insert : 1333631029 To insert : 1333631030 To insert : 1333631031 To insert : 1333631153 To insert : 1333631154 To insert : 1333631155 To insert : 1333631156 To insert : 1333631157 To insert : 1333631158 To insert : 1333631159 To insert : 1333630552 To insert : 1333630554 To insert : 1333630556 To insert : 1333630559 To insert : 1333630565 To insert : 1333630567 To insert : 1333630688 To insert : 1333630689 To insert : 1333630690 To insert : 1333630691 To insert : 1333630692 To insert : 1333630693 To insert : 1333630694 To insert : 1333630695 To insert : 1333630696 To insert : 1333630697 To insert : 1333630698 To insert : 1333630699 To insert : 1333630700 To insert : 1333630702 To insert : 1333630703 To insert : 1333630705 To insert : 1333630706 To insert : 1333630707 To insert : 1333630708 To insert : 1333630709 To insert : 1333630710 To insert : 1333630711 To insert : 1333630712 To insert : 1333630713 To insert : 1333630714 To insert : 1333630715 To insert : 1333630716 To insert : 1333630717 To insert : 1333630718 To insert : 1333630719 To insert : 1333630720 To insert : 1333630721 To insert : 1333630722 To insert : 1333630723 To insert : 1333630724 To insert : 1333630737 To insert : 1333630738 To insert : 1333630739 To insert : 1333630740 To insert : 1333630741 To insert : 1333630742 To insert : 1333630743 To insert : 1333630745 To insert : 1333630748 To insert : 1333630750 To insert : 1333630752 To insert : 1333630323 To insert : 1333630325 To insert : 1333630327 To insert : 1333630329 To insert : 1333630331 To insert : 1333630333 To insert : 1333630335 To insert : 1333630337 To insert : 1333630341 To insert : 1333630343 To insert : 1333630344 To insert : 1333630346 To insert : 1333630349 To insert : 1333630354 To insert : 1333630356 To insert : 1333630358 To insert : 1333630359 To insert : 1333630361 To insert : 1333630363 To insert : 1333630365 To insert : 1333630367 To insert : 1333630370 To insert : 1333630372 To insert : 1333630374 To insert : 1333630375 To insert : 1333630376 To insert : 1333630275 To insert : 1333630278 To insert : 1333630282 To insert : 1333630284 To insert : 1333630286 To insert : 1333630288 To insert : 1333630289 To insert : 1333630290 To insert : 1333630292 To insert : 1333630294 To insert : 1333630296 To insert : 1333630297 To insert : 1333630299 To insert : 1333630301 To insert : 1333630303 To insert : 1333630305 To insert : 1333630307 To insert : 1333630309 To insert : 1333630311 To insert : 1333630312 To insert : 1333630313 To insert : 1333630315 To insert : 1333630317 To insert : 1333630318 To insert : 1333630320 To insert : 1333630321 time to insert the descriptors : 46.69323372840881 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 402 time used for this insertion : 0.030238866806030273 save missing photos in datou_result : time spend for datou_step_exec : 56.515403509140015 time spend to save output : 0.09971737861633301 total time spend for step 5 : 56.61512088775635 step6:argmax Sat Feb 1 07:41:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou_step Argmax ! calculate argmax for thcl : 3233 Inside saveOutput : final : False verbose : 0 photo_id : 1333630754 output[photo_id] : [('1333630754', 'pehd', 0.72126573, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470596_0.png'] photo_id : 1333630756 output[photo_id] : [('1333630756', 'papier', 0.9455006, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470598_0.png'] photo_id : 1333630758 output[photo_id] : [('1333630758', 'carton', 0.49786666, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470594_0.png'] photo_id : 1333630761 output[photo_id] : [('1333630761', 'pehd', 0.6701133, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470664_0.png'] photo_id : 1333630762 output[photo_id] : [('1333630762', 'carton', 0.8905677, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470692_0.png'] photo_id : 1333630764 output[photo_id] : [('1333630764', 'papier', 0.7006702, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470699_0.png'] photo_id : 1333630766 output[photo_id] : [('1333630766', 'carton', 0.3400165, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470686_0.png'] photo_id : 1333630768 output[photo_id] : [('1333630768', 'metal', 0.42364717, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470695_0.png'] photo_id : 1333630770 output[photo_id] : [('1333630770', 'barquette_opaque', 0.553714, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470738_0.png'] photo_id : 1333630772 output[photo_id] : [('1333630772', 'barquette_opaque', 0.2696436, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470710_0.png'] photo_id : 1333630775 output[photo_id] : [('1333630775', 'pehd', 0.32364613, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470727_0.png'] photo_id : 1333630777 output[photo_id] : [('1333630777', 'carton', 0.46568695, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470720_0.png'] photo_id : 1333630779 output[photo_id] : [('1333630779', 'carton', 0.76192176, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470742_0.png'] photo_id : 1333630781 output[photo_id] : [('1333630781', 'papier', 0.33848017, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470767_0.png'] photo_id : 1333630783 output[photo_id] : [('1333630783', 'papier', 0.93644804, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470765_0.png'] photo_id : 1333630785 output[photo_id] : [('1333630785', 'metal', 0.28269088, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470752_0.png'] photo_id : 1333630787 output[photo_id] : [('1333630787', 'environnement', 0.7279564, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470772_0.png'] photo_id : 1333630789 output[photo_id] : [('1333630789', 'barquette_opaque', 0.9596294, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470782_0.png'] photo_id : 1333630901 output[photo_id] : [('1333630901', 'papier', 0.30665016, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470468_0.png'] photo_id : 1333630902 output[photo_id] : [('1333630902', 'carton', 0.2861003, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470546_0.png'] photo_id : 1333630903 output[photo_id] : [('1333630903', 'papier', 0.30209523, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470556_0.png'] photo_id : 1333630904 output[photo_id] : [('1333630904', 'film_plastique', 0.32380235, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470581_0.png'] photo_id : 1333630905 output[photo_id] : [('1333630905', 'papier', 0.79821545, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470565_0.png'] photo_id : 1333630906 output[photo_id] : [('1333630906', 'ela', 0.6018214, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470626_0.png'] photo_id : 1333630907 output[photo_id] : [('1333630907', 'papier', 0.90521634, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470614_0.png'] photo_id : 1333630908 output[photo_id] : [('1333630908', 'papier', 0.79201955, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470609_0.png'] photo_id : 1333631160 output[photo_id] : [('1333631160', 'pehd', 0.5980483, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470552_0.png'] photo_id : 1333631161 output[photo_id] : [('1333631161', 'barquette_opaque', 0.76852316, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470590_0.png'] photo_id : 1333631162 output[photo_id] : [('1333631162', 'pehd', 0.6695944, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470589_0.png'] photo_id : 1333631163 output[photo_id] : [('1333631163', 'metal', 0.42290372, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470602_0.png'] photo_id : 1333631164 output[photo_id] : [('1333631164', 'pehd', 0.99334747, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470624_0.png'] photo_id : 1333631165 output[photo_id] : [('1333631165', 'pehd', 0.7863073, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470649_0.png'] photo_id : 1333631166 output[photo_id] : [('1333631166', 'carton', 0.40391335, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470634_0.png'] photo_id : 1333631167 output[photo_id] : [('1333631167', 'pehd', 0.6699811, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470660_0.png'] photo_id : 1333631168 output[photo_id] : [('1333631168', 'carton', 0.5947458, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470703_0.png'] photo_id : 1333631169 output[photo_id] : [('1333631169', 'papier', 0.5551773, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470725_0.png'] photo_id : 1333631170 output[photo_id] : [('1333631170', 'papier', 0.73648244, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470715_0.png'] photo_id : 1333631171 output[photo_id] : [('1333631171', 'barquette_opaque', 0.55807054, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470713_0.png'] photo_id : 1333631172 output[photo_id] : [('1333631172', 'metal', 0.38979423, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470773_0.png'] photo_id : 1333631173 output[photo_id] : [('1333631173', 'barquette_opaque', 0.5877975, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470763_0.png'] photo_id : 1333631174 output[photo_id] : [('1333631174', 'pehd', 0.47579944, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470766_0.png'] photo_id : 1333631175 output[photo_id] : [('1333631175', 'ela', 0.7060755, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470789_0.png'] photo_id : 1333631177 output[photo_id] : [('1333631177', 'pet_opaque', 0.7910891, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470794_0.png'] photo_id : 1333631178 output[photo_id] : [('1333631178', 'carton', 0.9700224, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470798_0.png'] photo_id : 1333631179 output[photo_id] : [('1333631179', 'metal', 0.37060064, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470786_0.png'] photo_id : 1333631180 output[photo_id] : [('1333631180', 'papier', 0.25773087, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470793_0.png'] photo_id : 1333630986 output[photo_id] : [('1333630986', 'pehd', 0.9323716, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470619_0.png'] photo_id : 1333630987 output[photo_id] : [('1333630987', 'carton', 0.7958089, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470606_0.png'] photo_id : 1333630988 output[photo_id] : [('1333630988', 'papier', 0.63353455, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470625_0.png'] photo_id : 1333630989 output[photo_id] : [('1333630989', 'film_plastique', 0.70001966, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470611_0.png'] photo_id : 1333630990 output[photo_id] : [('1333630990', 'papier', 0.1970999, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470615_0.png'] photo_id : 1333630991 output[photo_id] : [('1333630991', 'pehd', 0.550898, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470616_0.png'] photo_id : 1333630992 output[photo_id] : [('1333630992', 'barquette_opaque', 0.9125138, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470623_0.png'] photo_id : 1333630993 output[photo_id] : [('1333630993', 'pehd', 0.8203114, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470661_0.png'] photo_id : 1333630994 output[photo_id] : [('1333630994', 'papier', 0.76342636, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470650_0.png'] photo_id : 1333630995 output[photo_id] : [('1333630995', 'pehd', 0.83445835, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470662_0.png'] photo_id : 1333630996 output[photo_id] : [('1333630996', 'pehd', 0.475877, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470652_0.png'] photo_id : 1333630997 output[photo_id] : [('1333630997', 'pehd', 0.32503617, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470639_0.png'] photo_id : 1333630998 output[photo_id] : [('1333630998', 'carton', 0.28440893, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470655_0.png'] photo_id : 1333630999 output[photo_id] : [('1333630999', 'ela', 0.799058, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470647_0.png'] photo_id : 1333631000 output[photo_id] : [('1333631000', 'papier', 0.9370819, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470656_0.png'] photo_id : 1333631001 output[photo_id] : [('1333631001', 'film_plastique', 0.5196721, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470691_0.png'] photo_id : 1333631002 output[photo_id] : [('1333631002', 'carton', 0.5160532, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470681_0.png'] photo_id : 1333631003 output[photo_id] : [('1333631003', 'carton', 0.35188228, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470702_0.png'] photo_id : 1333631004 output[photo_id] : [('1333631004', 'papier', 0.696462, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470696_0.png'] photo_id : 1333631005 output[photo_id] : [('1333631005', 'papier', 0.40502912, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470700_0.png'] photo_id : 1333631006 output[photo_id] : [('1333631006', 'carton', 0.5629327, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470694_0.png'] photo_id : 1333631007 output[photo_id] : [('1333631007', 'papier', 0.55967855, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470728_0.png'] photo_id : 1333631008 output[photo_id] : [('1333631008', 'barquette_opaque', 0.8016948, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470716_0.png'] photo_id : 1333631009 output[photo_id] : [('1333631009', 'pehd', 0.8030496, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470730_0.png'] photo_id : 1333631010 output[photo_id] : [('1333631010', 'papier', 0.4311536, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470732_0.png'] photo_id : 1333631011 output[photo_id] : [('1333631011', 'papier', 0.9096755, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470714_0.png'] photo_id : 1333630909 output[photo_id] : [('1333630909', 'papier', 0.6155033, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470641_0.png'] photo_id : 1333630910 output[photo_id] : [('1333630910', 'papier', 0.91976607, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470705_0.png'] photo_id : 1333630911 output[photo_id] : [('1333630911', 'papier', 0.5870371, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470682_0.png'] photo_id : 1333630912 output[photo_id] : [('1333630912', 'papier', 0.49245209, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470734_0.png'] photo_id : 1333630913 output[photo_id] : [('1333630913', 'papier', 0.5520284, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470774_0.png'] photo_id : 1333630965 output[photo_id] : [('1333630965', 'barquette_opaque', 0.49661776, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470453_0.png'] photo_id : 1333630966 output[photo_id] : [('1333630966', 'pehd', 0.50922465, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470455_0.png'] photo_id : 1333630967 output[photo_id] : [('1333630967', 'etiquette', 0.4092822, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470464_0.png'] photo_id : 1333630968 output[photo_id] : [('1333630968', 'film_plastique', 0.2955452, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470458_0.png'] photo_id : 1333630969 output[photo_id] : [('1333630969', 'papier', 0.785715, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470465_0.png'] photo_id : 1333630970 output[photo_id] : [('1333630970', 'pehd', 0.29124713, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470461_0.png'] photo_id : 1333630971 output[photo_id] : [('1333630971', 'ela', 0.49395806, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470469_0.png'] photo_id : 1333630972 output[photo_id] : [('1333630972', 'film_plastique', 0.35336062, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470463_0.png'] photo_id : 1333630973 output[photo_id] : [('1333630973', 'metal', 0.4301997, 4151, '3233'), 'temp/1738391668_3674520_1333211559_3b126c04aad80924e81b5816ecd4d5b1_rle_crop_3648470500_0.png'] photo_id : 1333630974 output[photo_id] : [('1333630974', 'barquette_opaque', 0.57665855, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470540_0.png'] photo_id : 1333630975 output[photo_id] : [('1333630975', 'metal', 0.33909988, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470513_0.png'] photo_id : 1333630976 output[photo_id] : [('1333630976', 'pehd', 0.86160606, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470545_0.png'] photo_id : 1333630977 output[photo_id] : [('1333630977', 'papier', 0.5826384, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470541_0.png'] photo_id : 1333630978 output[photo_id] : [('1333630978', 'papier', 0.65244573, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470570_0.png'] photo_id : 1333630979 output[photo_id] : [('1333630979', 'carton', 0.31866255, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470584_0.png'] photo_id : 1333630980 output[photo_id] : [('1333630980', 'papier', 0.30424553, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470580_0.png'] photo_id : 1333630981 output[photo_id] : [('1333630981', 'barquette_opaque', 0.2891016, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470558_0.png'] photo_id : 1333630982 output[photo_id] : [('1333630982', 'papier', 0.45228747, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470564_0.png'] photo_id : 1333630983 output[photo_id] : [('1333630983', 'pehd', 0.38712123, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470574_0.png'] photo_id : 1333630984 output[photo_id] : [('1333630984', 'film_plastique', 0.54179597, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470557_0.png'] photo_id : 1333630985 output[photo_id] : [('1333630985', 'film_plastique', 0.76103437, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470620_0.png'] photo_id : 1333630377 output[photo_id] : [('1333630377', 'pehd', 0.4863343, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470775_0.png'] photo_id : 1333630379 output[photo_id] : [('1333630379', 'film_plastique', 0.4417736, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470746_0.png'] photo_id : 1333630381 output[photo_id] : [('1333630381', 'barquette_opaque', 0.37422618, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470745_0.png'] photo_id : 1333630383 output[photo_id] : [('1333630383', 'pehd', 0.6666389, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470750_0.png'] photo_id : 1333630385 output[photo_id] : [('1333630385', 'carton', 0.44036037, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470748_0.png'] photo_id : 1333630387 output[photo_id] : [('1333630387', 'papier', 0.70669943, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470803_0.png'] photo_id : 1333630389 output[photo_id] : [('1333630389', 'pehd', 0.5573099, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470779_0.png'] photo_id : 1333630390 output[photo_id] : [('1333630390', 'pehd', 0.41755924, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470788_0.png'] photo_id : 1333630392 output[photo_id] : [('1333630392', 'papier', 0.311259, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470799_0.png'] photo_id : 1333630394 output[photo_id] : [('1333630394', 'pehd', 0.45675123, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470785_0.png'] photo_id : 1333630395 output[photo_id] : [('1333630395', 'carton', 0.5100085, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470805_0.png'] photo_id : 1333630399 output[photo_id] : [('1333630399', 'carton', 0.28989235, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470804_0.png'] photo_id : 1333630525 output[photo_id] : [('1333630525', 'pehd', 0.4290604, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470459_0.png'] photo_id : 1333630527 output[photo_id] : [('1333630527', 'carton', 0.34074718, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470472_0.png'] photo_id : 1333630529 output[photo_id] : [('1333630529', 'papier', 0.6564303, 4151, '3233'), 'temp/1738391668_3674520_1333211559_3b126c04aad80924e81b5816ecd4d5b1_rle_crop_3648470478_0.png'] photo_id : 1333630531 output[photo_id] : [('1333630531', 'carton', 0.67656976, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470505_0.png'] photo_id : 1333630532 output[photo_id] : [('1333630532', 'papier', 0.9647728, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470518_0.png'] photo_id : 1333630533 output[photo_id] : [('1333630533', 'pehd', 0.45884717, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470534_0.png'] photo_id : 1333630534 output[photo_id] : [('1333630534', 'papier', 0.52437735, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470532_0.png'] photo_id : 1333630537 output[photo_id] : [('1333630537', 'papier', 0.8956934, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470510_0.png'] photo_id : 1333630539 output[photo_id] : [('1333630539', 'papier', 0.96326625, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470531_0.png'] photo_id : 1333630541 output[photo_id] : [('1333630541', 'papier', 0.4072665, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470516_0.png'] photo_id : 1333630543 output[photo_id] : [('1333630543', 'papier', 0.9079118, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470622_0.png'] photo_id : 1333630545 output[photo_id] : [('1333630545', 'carton', 0.58301544, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470628_0.png'] photo_id : 1333630548 output[photo_id] : [('1333630548', 'carton', 0.40061244, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470653_0.png'] photo_id : 1333630550 output[photo_id] : [('1333630550', 'carton', 0.6628447, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470701_0.png'] photo_id : 1333631013 output[photo_id] : [('1333631013', 'papier', 0.9493992, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470729_0.png'] photo_id : 1333631014 output[photo_id] : [('1333631014', 'papier', 0.2728107, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470731_0.png'] photo_id : 1333631015 output[photo_id] : [('1333631015', 'ela', 0.40680215, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470737_0.png'] photo_id : 1333631016 output[photo_id] : [('1333631016', 'carton', 0.607826, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470726_0.png'] photo_id : 1333631017 output[photo_id] : [('1333631017', 'pehd', 0.4240859, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470762_0.png'] photo_id : 1333631018 output[photo_id] : [('1333631018', 'film_plastique', 0.70291597, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470770_0.png'] photo_id : 1333631019 output[photo_id] : [('1333631019', 'carton', 0.47559807, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470754_0.png'] photo_id : 1333631020 output[photo_id] : [('1333631020', 'pehd', 0.3169246, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470761_0.png'] photo_id : 1333631021 output[photo_id] : [('1333631021', 'carton', 0.33909085, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470777_0.png'] photo_id : 1333631022 output[photo_id] : [('1333631022', 'carton', 0.3026096, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470760_0.png'] photo_id : 1333631023 output[photo_id] : [('1333631023', 'papier', 0.50725603, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470755_0.png'] photo_id : 1333631024 output[photo_id] : [('1333631024', 'pehd', 0.3870275, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470753_0.png'] photo_id : 1333631025 output[photo_id] : [('1333631025', 'carton', 0.36000374, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470747_0.png'] photo_id : 1333631026 output[photo_id] : [('1333631026', 'carton', 0.58184975, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470756_0.png'] photo_id : 1333631027 output[photo_id] : [('1333631027', 'carton', 0.65168864, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470776_0.png'] photo_id : 1333631028 output[photo_id] : [('1333631028', 'film_plastique', 0.45171943, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470796_0.png'] photo_id : 1333631029 output[photo_id] : [('1333631029', 'pehd', 0.8102389, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470792_0.png'] photo_id : 1333631030 output[photo_id] : [('1333631030', 'papier', 0.6745411, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470791_0.png'] photo_id : 1333631031 output[photo_id] : [('1333631031', 'papier', 0.38085184, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470795_0.png'] photo_id : 1333631153 output[photo_id] : [('1333631153', 'barquette_opaque', 0.75081444, 4151, '3233'), 'temp/1738391668_3674520_1333211559_3b126c04aad80924e81b5816ecd4d5b1_rle_crop_3648470485_0.png'] photo_id : 1333631154 output[photo_id] : [('1333631154', 'carton', 0.67024326, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470506_0.png'] photo_id : 1333631155 output[photo_id] : [('1333631155', 'pehd', 0.9976705, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470543_0.png'] photo_id : 1333631156 output[photo_id] : [('1333631156', 'pehd', 0.77744836, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470563_0.png'] photo_id : 1333631157 output[photo_id] : [('1333631157', 'pehd', 0.5755154, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470568_0.png'] photo_id : 1333631158 output[photo_id] : [('1333631158', 'metal', 0.44707412, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470583_0.png'] photo_id : 1333631159 output[photo_id] : [('1333631159', 'pehd', 0.5020593, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470551_0.png'] photo_id : 1333630552 output[photo_id] : [('1333630552', 'carton', 0.91940624, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470683_0.png'] photo_id : 1333630554 output[photo_id] : [('1333630554', 'carton', 0.49857807, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470678_0.png'] photo_id : 1333630556 output[photo_id] : [('1333630556', 'film_plastique', 0.2609652, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470693_0.png'] photo_id : 1333630559 output[photo_id] : [('1333630559', 'carton', 0.41001117, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470722_0.png'] photo_id : 1333630565 output[photo_id] : [('1333630565', 'papier', 0.7413801, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470736_0.png'] photo_id : 1333630567 output[photo_id] : [('1333630567', 'pehd', 0.98941153, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470749_0.png'] photo_id : 1333630688 output[photo_id] : [('1333630688', 'pehd', 0.602433, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470477_0.png'] photo_id : 1333630689 output[photo_id] : [('1333630689', 'papier', 0.63042307, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470456_0.png'] photo_id : 1333630690 output[photo_id] : [('1333630690', 'papier', 0.73929447, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470476_0.png'] photo_id : 1333630691 output[photo_id] : [('1333630691', 'papier', 0.614639, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470475_0.png'] photo_id : 1333630692 output[photo_id] : [('1333630692', 'barquette_opaque', 0.86800027, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470526_0.png'] photo_id : 1333630693 output[photo_id] : [('1333630693', 'carton', 0.28767562, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470517_0.png'] photo_id : 1333630694 output[photo_id] : [('1333630694', 'carton', 0.46323526, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470537_0.png'] photo_id : 1333630695 output[photo_id] : [('1333630695', 'papier', 0.24344973, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470544_0.png'] photo_id : 1333630696 output[photo_id] : [('1333630696', 'papier', 0.46951935, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470525_0.png'] photo_id : 1333630697 output[photo_id] : [('1333630697', 'film_plastique', 0.47176722, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470528_0.png'] photo_id : 1333630698 output[photo_id] : [('1333630698', 'carton', 0.5882866, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470530_0.png'] photo_id : 1333630699 output[photo_id] : [('1333630699', 'carton', 0.9687029, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470511_0.png'] photo_id : 1333630700 output[photo_id] : [('1333630700', 'carton', 0.590131, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470523_0.png'] photo_id : 1333630702 output[photo_id] : [('1333630702', 'film_plastique', 0.92807454, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470520_0.png'] photo_id : 1333630703 output[photo_id] : [('1333630703', 'film_plastique', 0.9483095, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470567_0.png'] photo_id : 1333630705 output[photo_id] : [('1333630705', 'pehd', 0.357547, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470575_0.png'] photo_id : 1333630706 output[photo_id] : [('1333630706', 'carton', 0.3100338, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470585_0.png'] photo_id : 1333630707 output[photo_id] : [('1333630707', 'film_plastique', 0.78339523, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470621_0.png'] photo_id : 1333630708 output[photo_id] : [('1333630708', 'carton', 0.53265464, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470633_0.png'] photo_id : 1333630709 output[photo_id] : [('1333630709', 'pehd', 0.29390994, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470638_0.png'] photo_id : 1333630710 output[photo_id] : [('1333630710', 'papier', 0.6383662, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470637_0.png'] photo_id : 1333630711 output[photo_id] : [('1333630711', 'papier', 0.58976597, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470643_0.png'] photo_id : 1333630712 output[photo_id] : [('1333630712', 'papier', 0.43383223, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470698_0.png'] photo_id : 1333630713 output[photo_id] : [('1333630713', 'pehd', 0.28058922, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470704_0.png'] photo_id : 1333630714 output[photo_id] : [('1333630714', 'barquette_opaque', 0.24672031, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470687_0.png'] photo_id : 1333630715 output[photo_id] : [('1333630715', 'pehd', 0.5825796, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470721_0.png'] photo_id : 1333630716 output[photo_id] : [('1333630716', 'papier', 0.44852874, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470724_0.png'] photo_id : 1333630717 output[photo_id] : [('1333630717', 'pehd', 0.4707414, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470719_0.png'] photo_id : 1333630718 output[photo_id] : [('1333630718', 'film_plastique', 0.41056567, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470718_0.png'] photo_id : 1333630719 output[photo_id] : [('1333630719', 'carton', 0.42138842, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470739_0.png'] photo_id : 1333630720 output[photo_id] : [('1333630720', 'papier', 0.925984, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470735_0.png'] photo_id : 1333630721 output[photo_id] : [('1333630721', 'papier', 0.583449, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470800_0.png'] photo_id : 1333630722 output[photo_id] : [('1333630722', 'papier', 0.4310774, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470802_0.png'] photo_id : 1333630723 output[photo_id] : [('1333630723', 'film_plastique', 0.38067207, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470797_0.png'] photo_id : 1333630724 output[photo_id] : [('1333630724', 'papier', 0.49981952, 4151, '3233'), 'temp/1738391668_3674520_1333211400_eb52ae37f22333d3504923adbbfc78b6_rle_crop_3648470801_0.png'] photo_id : 1333630737 output[photo_id] : [('1333630737', 'pehd', 0.95062447, 4151, '3233'), 'temp/1738391668_3674520_1333211559_3b126c04aad80924e81b5816ecd4d5b1_rle_crop_3648470490_0.png'] photo_id : 1333630738 output[photo_id] : [('1333630738', 'carton', 0.39382318, 4151, '3233'), 'temp/1738391668_3674520_1333211559_3b126c04aad80924e81b5816ecd4d5b1_rle_crop_3648470501_0.png'] photo_id : 1333630739 output[photo_id] : [('1333630739', 'ela', 0.44946814, 4151, '3233'), 'temp/1738391668_3674520_1333211559_3b126c04aad80924e81b5816ecd4d5b1_rle_crop_3648470502_0.png'] photo_id : 1333630740 output[photo_id] : [('1333630740', 'papier', 0.87561625, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470536_0.png'] photo_id : 1333630741 output[photo_id] : [('1333630741', 'carton', 0.2632494, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470529_0.png'] photo_id : 1333630742 output[photo_id] : [('1333630742', 'papier', 0.33348694, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470524_0.png'] photo_id : 1333630743 output[photo_id] : [('1333630743', 'environnement', 0.25801137, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470542_0.png'] photo_id : 1333630745 output[photo_id] : [('1333630745', 'metal', 0.7992174, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470521_0.png'] photo_id : 1333630748 output[photo_id] : [('1333630748', 'carton', 0.62344927, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470538_0.png'] photo_id : 1333630750 output[photo_id] : [('1333630750', 'carton', 0.35136166, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470582_0.png'] photo_id : 1333630752 output[photo_id] : [('1333630752', 'pehd', 0.7301226, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470601_0.png'] photo_id : 1333630323 output[photo_id] : [('1333630323', 'pehd', 0.80604905, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470595_0.png'] photo_id : 1333630325 output[photo_id] : [('1333630325', 'papier', 0.74868757, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470613_0.png'] photo_id : 1333630327 output[photo_id] : [('1333630327', 'barquette_opaque', 0.94088525, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470617_0.png'] photo_id : 1333630329 output[photo_id] : [('1333630329', 'barquette_opaque', 0.58661777, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470612_0.png'] photo_id : 1333630331 output[photo_id] : [('1333630331', 'film_plastique', 0.512585, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470618_0.png'] photo_id : 1333630333 output[photo_id] : [('1333630333', 'pehd', 0.8198501, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470603_0.png'] photo_id : 1333630335 output[photo_id] : [('1333630335', 'pehd', 0.41579482, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470608_0.png'] photo_id : 1333630337 output[photo_id] : [('1333630337', 'barquette_opaque', 0.9809988, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470642_0.png'] photo_id : 1333630341 output[photo_id] : [('1333630341', 'pehd', 0.47531942, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470658_0.png'] photo_id : 1333630343 output[photo_id] : [('1333630343', 'pehd', 0.9851747, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470646_0.png'] photo_id : 1333630344 output[photo_id] : [('1333630344', 'barquette_opaque', 0.43548715, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470654_0.png'] photo_id : 1333630346 output[photo_id] : [('1333630346', 'carton', 0.3469301, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470648_0.png'] photo_id : 1333630349 output[photo_id] : [('1333630349', 'pehd', 0.9643985, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470657_0.png'] photo_id : 1333630354 output[photo_id] : [('1333630354', 'papier', 0.5021435, 4151, '3233'), 'temp/1738391668_3674520_1333211507_0111f3113434a5f08ce998b2de545606_rle_crop_3648470663_0.png'] photo_id : 1333630356 output[photo_id] : [('1333630356', 'pehd', 0.5682364, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470675_0.png'] photo_id : 1333630358 output[photo_id] : [('1333630358', 'carton', 0.5288238, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470697_0.png'] photo_id : 1333630359 output[photo_id] : [('1333630359', 'pehd', 0.53117234, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470688_0.png'] photo_id : 1333630361 output[photo_id] : [('1333630361', 'carton', 0.3115843, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470706_0.png'] photo_id : 1333630363 output[photo_id] : [('1333630363', 'carton', 0.7895584, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470690_0.png'] photo_id : 1333630365 output[photo_id] : [('1333630365', 'carton', 0.23559715, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470674_0.png'] photo_id : 1333630367 output[photo_id] : [('1333630367', 'carton', 0.4927021, 4151, '3233'), 'temp/1738391668_3674520_1333211502_6b64720fa08c3fd687a1d6aa972a54f4_rle_crop_3648470679_0.png'] photo_id : 1333630370 output[photo_id] : [('1333630370', 'metal', 0.43070155, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470733_0.png'] photo_id : 1333630372 output[photo_id] : [('1333630372', 'carton', 0.328075, 4151, '3233'), 'temp/1738391668_3674520_1333211499_9634fe8009813a1569620af99346ad01_rle_crop_3648470712_0.png'] photo_id : 1333630374 output[photo_id] : [('1333630374', 'pehd', 0.41301513, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470751_0.png'] photo_id : 1333630375 output[photo_id] : [('1333630375', 'pehd', 0.4679093, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470768_0.png'] photo_id : 1333630376 output[photo_id] : [('1333630376', 'pehd', 0.35175255, 4151, '3233'), 'temp/1738391668_3674520_1333211467_a2c0368b03a853465e1f88fc73f04167_rle_crop_3648470764_0.png'] photo_id : 1333630275 output[photo_id] : [('1333630275', 'barquette_opaque', 0.8990093, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470457_0.png'] photo_id : 1333630278 output[photo_id] : [('1333630278', 'papier', 0.39626783, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470470_0.png'] photo_id : 1333630282 output[photo_id] : [('1333630282', 'papier', 0.3645875, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470473_0.png'] photo_id : 1333630284 output[photo_id] : [('1333630284', 'papier', 0.9109247, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470471_0.png'] photo_id : 1333630286 output[photo_id] : [('1333630286', 'carton', 0.38985592, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470474_0.png'] photo_id : 1333630288 output[photo_id] : [('1333630288', 'pehd', 0.47896826, 4151, '3233'), 'temp/1738391668_3674520_1333211566_0ad1867bca3501f82ce01abfeb9f94a3_rle_crop_3648470452_0.png'] photo_id : 1333630289 output[photo_id] : [('1333630289', 'carton', 0.7669558, 4151, '3233'), 'temp/1738391668_3674520_1333211559_3b126c04aad80924e81b5816ecd4d5b1_rle_crop_3648470487_0.png'] photo_id : 1333630290 output[photo_id] : [('1333630290', 'pehd', 0.8372167, 4151, '3233'), 'temp/1738391668_3674520_1333211559_3b126c04aad80924e81b5816ecd4d5b1_rle_crop_3648470480_0.png'] photo_id : 1333630292 output[photo_id] : [('1333630292', 'pehd', 0.70065534, 4151, '3233'), 'temp/1738391668_3674520_1333211559_3b126c04aad80924e81b5816ecd4d5b1_rle_crop_3648470492_0.png'] photo_id : 1333630294 output[photo_id] : [('1333630294', 'pehd', 0.4809147, 4151, '3233'), 'temp/1738391668_3674520_1333211559_3b126c04aad80924e81b5816ecd4d5b1_rle_crop_3648470497_0.png'] photo_id : 1333630296 output[photo_id] : [('1333630296', 'pehd', 0.3460841, 4151, '3233'), 'temp/1738391668_3674520_1333211559_3b126c04aad80924e81b5816ecd4d5b1_rle_crop_3648470494_0.png'] photo_id : 1333630297 output[photo_id] : [('1333630297', 'pehd', 0.90770525, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470519_0.png'] photo_id : 1333630299 output[photo_id] : [('1333630299', 'film_plastique', 0.35240194, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470508_0.png'] photo_id : 1333630301 output[photo_id] : [('1333630301', 'film_plastique', 0.6997093, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470535_0.png'] photo_id : 1333630303 output[photo_id] : [('1333630303', 'carton', 0.41352433, 4151, '3233'), 'temp/1738391668_3674520_1333211553_967d9ac1a5b56e5a3bd641eb65cad313_rle_crop_3648470527_0.png'] photo_id : 1333630305 output[photo_id] : [('1333630305', 'pehd', 0.45233428, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470561_0.png'] photo_id : 1333630307 output[photo_id] : [('1333630307', 'carton', 0.89134234, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470572_0.png'] photo_id : 1333630309 output[photo_id] : [('1333630309', 'carton', 0.42170346, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470550_0.png'] photo_id : 1333630311 output[photo_id] : [('1333630311', 'film_plastique', 0.50271165, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470553_0.png'] photo_id : 1333630312 output[photo_id] : [('1333630312', 'film_plastique', 0.5487164, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470578_0.png'] photo_id : 1333630313 output[photo_id] : [('1333630313', 'pehd', 0.35584682, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470579_0.png'] photo_id : 1333630315 output[photo_id] : [('1333630315', 'film_plastique', 0.33136845, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470573_0.png'] photo_id : 1333630317 output[photo_id] : [('1333630317', 'pehd', 0.6633091, 4151, '3233'), 'temp/1738391668_3674520_1333211539_a73db9c636b029027a41b752267342ed_rle_crop_3648470576_0.png'] photo_id : 1333630318 output[photo_id] : [('1333630318', 'pehd', 0.7333335, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470593_0.png'] photo_id : 1333630320 output[photo_id] : [('1333630320', 'pehd', 0.9604856, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470610_0.png'] photo_id : 1333630321 output[photo_id] : [('1333630321', 'carton', 0.81860757, 4151, '3233'), 'temp/1738391668_3674520_1333211511_73577f0bbd98d5b6252cbb6c83290549_rle_crop_3648470600_0.png'] begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 254 time used for this insertion : 0.05494284629821777 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 254 time used for this insertion : 0.028767824172973633 save missing photos in datou_result : time spend for datou_step_exec : 0.0036034584045410156 time spend to save output : 0.08745360374450684 total time spend for step 6 : 0.09105706214904785 step7:merge_mask_thcl_custom Sat Feb 1 07:41:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step merge_mask_thcl_custom this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it batch 1 Loaded 358 chid ids of type : 3760 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++As expected we have just one thcl present begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : batch 1 Loaded 254 chid ids of type : 4210 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 254 chid ids of type : 4210 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++End of step merge_mask_thcl_custom Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : merge_mask_thcl_custom we use saveGeneral [1333211566, 1333211559, 1333211553, 1333211539, 1333211511, 1333211507, 1333211502, 1333211499, 1333211467, 1333211400] Looping around the photos to save general results len do output : 10 /1333211566Didn't retrieve data .Didn't retrieve data . /1333211559Didn't retrieve data .Didn't retrieve data . /1333211553Didn't retrieve data .Didn't retrieve data . /1333211539Didn't retrieve data .Didn't retrieve data . /1333211511Didn't retrieve data .Didn't retrieve data . /1333211507Didn't retrieve data .Didn't retrieve data . /1333211502Didn't retrieve data .Didn't retrieve data . /1333211499Didn't retrieve data .Didn't retrieve data . /1333211467Didn't retrieve data .Didn't retrieve data . /1333211400Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211566', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211559', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211553', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211539', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211511', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211507', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211502', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211499', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211467', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211400', None, None, None, None, None, '2532921') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.017730236053466797 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.3904955387115479 time spend to save output : 0.0182344913482666 total time spend for step 7 : 1.4087300300598145 step8:rle_unique_nms_with_priority Sat Feb 1 07:41:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms nb_obj : 21 nb_hashtags : 7 time to prepare the origin masks : 14.150362968444824 time for calcul the mask position with numpy : 0.2938578128814697 nb_pixel_total : 6722599 time to create 1 rle with new method : 0.9354684352874756 time for calcul the mask position with numpy : 0.02842116355895996 nb_pixel_total : 39402 time to create 1 rle with old method : 0.03923225402832031 time for calcul the mask position with numpy : 0.028452396392822266 nb_pixel_total : 37761 time to create 1 rle with old method : 0.038773298263549805 time for calcul the mask position with numpy : 0.027174949645996094 nb_pixel_total : 19034 time to create 1 rle with old method : 0.018834829330444336 time for calcul the mask position with numpy : 0.026529312133789062 nb_pixel_total : 8387 time to create 1 rle with old method : 0.008327960968017578 time for calcul the mask position with numpy : 0.02724933624267578 nb_pixel_total : 62712 time to create 1 rle with old method : 0.06207561492919922 time for calcul the mask position with numpy : 0.02729487419128418 nb_pixel_total : 53989 time to create 1 rle with old method : 0.05401468276977539 time for calcul the mask position with numpy : 0.027666568756103516 nb_pixel_total : 69128 time to create 1 rle with old method : 0.07342076301574707 time for calcul the mask position with numpy : 0.02875971794128418 nb_pixel_total : 60081 time to create 1 rle with old method : 0.06423664093017578 time for calcul the mask position with numpy : 0.02717423439025879 nb_pixel_total : 14347 time to create 1 rle with old method : 0.014380216598510742 time for calcul the mask position with numpy : 0.027938127517700195 nb_pixel_total : 28774 time to create 1 rle with old method : 0.02911376953125 time for calcul the mask position with numpy : 0.029719114303588867 nb_pixel_total : 206116 time to create 1 rle with new method : 0.7018740177154541 time for calcul the mask position with numpy : 0.030002117156982422 nb_pixel_total : 46595 time to create 1 rle with old method : 0.053431034088134766 time for calcul the mask position with numpy : 0.028504133224487305 nb_pixel_total : 36664 time to create 1 rle with old method : 0.03893327713012695 time for calcul the mask position with numpy : 0.034250497817993164 nb_pixel_total : 19375 time to create 1 rle with old method : 0.021712541580200195 time for calcul the mask position with numpy : 0.034944772720336914 nb_pixel_total : 85668 time to create 1 rle with old method : 0.09295177459716797 time for calcul the mask position with numpy : 0.044296979904174805 nb_pixel_total : 97958 time to create 1 rle with old method : 0.10744166374206543 time for calcul the mask position with numpy : 0.04423046112060547 nb_pixel_total : 20604 time to create 1 rle with old method : 0.021120786666870117 time for calcul the mask position with numpy : 0.044072866439819336 nb_pixel_total : 31020 time to create 1 rle with old method : 0.031101703643798828 time for calcul the mask position with numpy : 0.04873800277709961 nb_pixel_total : 18419 time to create 1 rle with old method : 0.021049022674560547 time for calcul the mask position with numpy : 0.05054974555969238 nb_pixel_total : 494212 time to create 1 rle with new method : 0.7161722183227539 time for calcul the mask position with numpy : 0.04444241523742676 nb_pixel_total : 121555 time to create 1 rle with old method : 0.1263127326965332 create new chi : 4.386332988739014 time to delete rle : 0.04978179931640625 batch 1 Loaded 22 chid ids of type : 4211 Number RLEs to save : 15327 TO DO : save crop sub photo not yet done ! save time : 0.9704208374023438 nb_obj : 11 nb_hashtags : 6 time to prepare the origin masks : 9.116894721984863 time for calcul the mask position with numpy : 0.4356205463409424 nb_pixel_total : 7790144 time to create 1 rle with new method : 0.747338056564331 time for calcul the mask position with numpy : 0.03865933418273926 nb_pixel_total : 52361 time to create 1 rle with old method : 0.0640566349029541 time for calcul the mask position with numpy : 0.04761958122253418 nb_pixel_total : 71233 time to create 1 rle with old method : 0.07559466361999512 time for calcul the mask position with numpy : 0.042237281799316406 nb_pixel_total : 41461 time to create 1 rle with old method : 0.0450749397277832 time for calcul the mask position with numpy : 0.039739131927490234 nb_pixel_total : 12251 time to create 1 rle with old method : 0.013597249984741211 time for calcul the mask position with numpy : 0.04026055335998535 nb_pixel_total : 83377 time to create 1 rle with old method : 0.08736467361450195 time for calcul the mask position with numpy : 0.038387298583984375 nb_pixel_total : 5001 time to create 1 rle with old method : 0.005521535873413086 time for calcul the mask position with numpy : 0.03890085220336914 nb_pixel_total : 43536 time to create 1 rle with old method : 0.04822897911071777 time for calcul the mask position with numpy : 0.03749728202819824 nb_pixel_total : 32370 time to create 1 rle with old method : 0.03372502326965332 time for calcul the mask position with numpy : 0.02551722526550293 nb_pixel_total : 64807 time to create 1 rle with old method : 0.07011127471923828 time for calcul the mask position with numpy : 0.024038314819335938 nb_pixel_total : 51330 time to create 1 rle with old method : 0.05034017562866211 time for calcul the mask position with numpy : 0.02418828010559082 nb_pixel_total : 46529 time to create 1 rle with old method : 0.05013275146484375 create new chi : 2.17777419090271 time to delete rle : 0.0008893013000488281 batch 1 Loaded 12 chid ids of type : 4211 Number RLEs to save : 7762 TO DO : save crop sub photo not yet done ! save time : 0.441164493560791 nb_obj : 34 nb_hashtags : 7 time to prepare the origin masks : 18.169496536254883 time for calcul the mask position with numpy : 0.5013978481292725 nb_pixel_total : 6557458 time to create 1 rle with new method : 0.5732438564300537 time for calcul the mask position with numpy : 0.03438210487365723 nb_pixel_total : 54994 time to create 1 rle with old method : 0.05993008613586426 time for calcul the mask position with numpy : 0.03367304801940918 nb_pixel_total : 9808 time to create 1 rle with old method : 0.010135173797607422 time for calcul the mask position with numpy : 0.03370833396911621 nb_pixel_total : 23324 time to create 1 rle with old method : 0.025585651397705078 time for calcul the mask position with numpy : 0.03450608253479004 nb_pixel_total : 102197 time to create 1 rle with old method : 0.11275339126586914 time for calcul the mask position with numpy : 0.03345465660095215 nb_pixel_total : 84025 time to create 1 rle with old method : 0.08527636528015137 time for calcul the mask position with numpy : 0.03449535369873047 nb_pixel_total : 11299 time to create 1 rle with old method : 0.012346982955932617 time for calcul the mask position with numpy : 0.033759355545043945 nb_pixel_total : 9175 time to create 1 rle with old method : 0.011246204376220703 time for calcul the mask position with numpy : 0.03531694412231445 nb_pixel_total : 61501 time to create 1 rle with old method : 0.06855225563049316 time for calcul the mask position with numpy : 0.033935546875 nb_pixel_total : 31648 time to create 1 rle with old method : 0.03323769569396973 time for calcul the mask position with numpy : 0.0349271297454834 nb_pixel_total : 72734 time to create 1 rle with old method : 0.07297706604003906 time for calcul the mask position with numpy : 0.03218555450439453 nb_pixel_total : 20843 time to create 1 rle with old method : 0.022602558135986328 time for calcul the mask position with numpy : 0.033872365951538086 nb_pixel_total : 55567 time to create 1 rle with old method : 0.05784296989440918 time for calcul the mask position with numpy : 0.03280353546142578 nb_pixel_total : 30676 time to create 1 rle with old method : 0.03015589714050293 time for calcul the mask position with numpy : 0.031476736068725586 nb_pixel_total : 31867 time to create 1 rle with old method : 0.031441450119018555 time for calcul the mask position with numpy : 0.031716108322143555 nb_pixel_total : 236 time to create 1 rle with old method : 0.0004324913024902344 time for calcul the mask position with numpy : 0.034470319747924805 nb_pixel_total : 38680 time to create 1 rle with old method : 0.04016590118408203 time for calcul the mask position with numpy : 0.033300161361694336 nb_pixel_total : 5226 time to create 1 rle with old method : 0.005529642105102539 time for calcul the mask position with numpy : 0.032274484634399414 nb_pixel_total : 22697 time to create 1 rle with old method : 0.024791240692138672 time for calcul the mask position with numpy : 0.03300905227661133 nb_pixel_total : 39747 time to create 1 rle with old method : 0.041925668716430664 time for calcul the mask position with numpy : 0.03200840950012207 nb_pixel_total : 105120 time to create 1 rle with old method : 0.102935791015625 time for calcul the mask position with numpy : 0.031928062438964844 nb_pixel_total : 43364 time to create 1 rle with old method : 0.04256105422973633 time for calcul the mask position with numpy : 0.0334019660949707 nb_pixel_total : 221573 time to create 1 rle with new method : 0.6921470165252686 time for calcul the mask position with numpy : 0.033982276916503906 nb_pixel_total : 55714 time to create 1 rle with old method : 0.058100223541259766 time for calcul the mask position with numpy : 0.03380537033081055 nb_pixel_total : 51211 time to create 1 rle with old method : 0.055795907974243164 time for calcul the mask position with numpy : 0.03376483917236328 nb_pixel_total : 65907 time to create 1 rle with old method : 0.06952857971191406 time for calcul the mask position with numpy : 0.03512310981750488 nb_pixel_total : 65500 time to create 1 rle with old method : 0.07213497161865234 time for calcul the mask position with numpy : 0.034482717514038086 nb_pixel_total : 71542 time to create 1 rle with old method : 0.07349801063537598 time for calcul the mask position with numpy : 0.03430438041687012 nb_pixel_total : 31776 time to create 1 rle with old method : 0.033974647521972656 time for calcul the mask position with numpy : 0.03424334526062012 nb_pixel_total : 111270 time to create 1 rle with old method : 0.12025117874145508 time for calcul the mask position with numpy : 0.03502702713012695 nb_pixel_total : 67398 time to create 1 rle with old method : 0.09881067276000977 time for calcul the mask position with numpy : 0.03920793533325195 nb_pixel_total : 84023 time to create 1 rle with old method : 0.09560775756835938 time for calcul the mask position with numpy : 0.03490257263183594 nb_pixel_total : 27827 time to create 1 rle with old method : 0.030125141143798828 time for calcul the mask position with numpy : 0.03479433059692383 nb_pixel_total : 16189 time to create 1 rle with old method : 0.017536163330078125 time for calcul the mask position with numpy : 0.03476858139038086 nb_pixel_total : 12284 time to create 1 rle with old method : 0.013923883438110352 create new chi : 4.619501829147339 time to delete rle : 0.0018062591552734375 batch 1 Loaded 35 chid ids of type : 4211 Number RLEs to save : 19484 TO DO : save crop sub photo not yet done ! save time : 1.676670789718628 nb_obj : 27 nb_hashtags : 6 time to prepare the origin masks : 14.794453382492065 time for calcul the mask position with numpy : 0.5141732692718506 nb_pixel_total : 6733349 time to create 1 rle with new method : 0.7364554405212402 time for calcul the mask position with numpy : 0.03320574760437012 nb_pixel_total : 28915 time to create 1 rle with old method : 0.02962017059326172 time for calcul the mask position with numpy : 0.03315091133117676 nb_pixel_total : 13262 time to create 1 rle with old method : 0.014070987701416016 time for calcul the mask position with numpy : 0.03354620933532715 nb_pixel_total : 12816 time to create 1 rle with old method : 0.01374959945678711 time for calcul the mask position with numpy : 0.03424525260925293 nb_pixel_total : 153557 time to create 1 rle with new method : 0.5909671783447266 time for calcul the mask position with numpy : 0.034722089767456055 nb_pixel_total : 119446 time to create 1 rle with old method : 0.1242671012878418 time for calcul the mask position with numpy : 0.03253531455993652 nb_pixel_total : 37869 time to create 1 rle with old method : 0.039214134216308594 time for calcul the mask position with numpy : 0.0336453914642334 nb_pixel_total : 62000 time to create 1 rle with old method : 0.06564188003540039 time for calcul the mask position with numpy : 0.03393101692199707 nb_pixel_total : 36049 time to create 1 rle with old method : 0.03906893730163574 time for calcul the mask position with numpy : 0.03388500213623047 nb_pixel_total : 54833 time to create 1 rle with old method : 0.06073570251464844 time for calcul the mask position with numpy : 0.03383588790893555 nb_pixel_total : 106047 time to create 1 rle with old method : 0.11339116096496582 time for calcul the mask position with numpy : 0.03368067741394043 nb_pixel_total : 21690 time to create 1 rle with old method : 0.023611783981323242 time for calcul the mask position with numpy : 0.03410649299621582 nb_pixel_total : 2519 time to create 1 rle with old method : 0.0030565261840820312 time for calcul the mask position with numpy : 0.034035444259643555 nb_pixel_total : 102188 time to create 1 rle with old method : 0.10795140266418457 time for calcul the mask position with numpy : 0.033257246017456055 nb_pixel_total : 53658 time to create 1 rle with old method : 0.05719780921936035 time for calcul the mask position with numpy : 0.03339719772338867 nb_pixel_total : 28411 time to create 1 rle with old method : 0.029851436614990234 time for calcul the mask position with numpy : 0.03518867492675781 nb_pixel_total : 129922 time to create 1 rle with old method : 0.14836883544921875 time for calcul the mask position with numpy : 0.03407001495361328 nb_pixel_total : 66149 time to create 1 rle with old method : 0.06971168518066406 time for calcul the mask position with numpy : 0.035928964614868164 nb_pixel_total : 17314 time to create 1 rle with old method : 0.01994180679321289 time for calcul the mask position with numpy : 0.05800271034240723 nb_pixel_total : 71141 time to create 1 rle with old method : 0.07848954200744629 time for calcul the mask position with numpy : 0.034929752349853516 nb_pixel_total : 99739 time to create 1 rle with old method : 0.10850310325622559 time for calcul the mask position with numpy : 0.03428053855895996 nb_pixel_total : 37463 time to create 1 rle with old method : 0.040523529052734375 time for calcul the mask position with numpy : 0.03774666786193848 nb_pixel_total : 146175 time to create 1 rle with old method : 0.1598982810974121 time for calcul the mask position with numpy : 0.03449892997741699 nb_pixel_total : 34280 time to create 1 rle with old method : 0.03729438781738281 time for calcul the mask position with numpy : 0.03354215621948242 nb_pixel_total : 50299 time to create 1 rle with old method : 0.07288765907287598 time for calcul the mask position with numpy : 0.041538238525390625 nb_pixel_total : 34082 time to create 1 rle with old method : 0.03741884231567383 time for calcul the mask position with numpy : 0.03458714485168457 nb_pixel_total : 29605 time to create 1 rle with old method : 0.037616729736328125 time for calcul the mask position with numpy : 0.039412736892700195 nb_pixel_total : 11622 time to create 1 rle with old method : 0.018274545669555664 create new chi : 4.419840574264526 time to delete rle : 0.002689361572265625 batch 1 Loaded 28 chid ids of type : 4211 Number RLEs to save : 18505 TO DO : save crop sub photo not yet done ! save time : 2.2172820568084717 nb_obj : 31 nb_hashtags : 7 time to prepare the origin masks : 12.441046476364136 time for calcul the mask position with numpy : 0.4402945041656494 nb_pixel_total : 6927684 time to create 1 rle with new method : 1.0664615631103516 time for calcul the mask position with numpy : 0.03490638732910156 nb_pixel_total : 11341 time to create 1 rle with old method : 0.01249837875366211 time for calcul the mask position with numpy : 0.03477787971496582 nb_pixel_total : 97999 time to create 1 rle with old method : 0.10573673248291016 time for calcul the mask position with numpy : 0.03519105911254883 nb_pixel_total : 9598 time to create 1 rle with old method : 0.011311531066894531 time for calcul the mask position with numpy : 0.03493452072143555 nb_pixel_total : 65567 time to create 1 rle with old method : 0.06981921195983887 time for calcul the mask position with numpy : 0.03513669967651367 nb_pixel_total : 8604 time to create 1 rle with old method : 0.009294748306274414 time for calcul the mask position with numpy : 0.03553652763366699 nb_pixel_total : 28406 time to create 1 rle with old method : 0.030464649200439453 time for calcul the mask position with numpy : 0.04073619842529297 nb_pixel_total : 53439 time to create 1 rle with old method : 0.05982017517089844 time for calcul the mask position with numpy : 0.03509783744812012 nb_pixel_total : 40528 time to create 1 rle with old method : 0.04546308517456055 time for calcul the mask position with numpy : 0.037055015563964844 nb_pixel_total : 25957 time to create 1 rle with old method : 0.031055927276611328 time for calcul the mask position with numpy : 0.03502178192138672 nb_pixel_total : 22744 time to create 1 rle with old method : 0.025346994400024414 time for calcul the mask position with numpy : 0.035396575927734375 nb_pixel_total : 107599 time to create 1 rle with old method : 0.11817383766174316 time for calcul the mask position with numpy : 0.034877777099609375 nb_pixel_total : 13841 time to create 1 rle with old method : 0.015029430389404297 time for calcul the mask position with numpy : 0.03572249412536621 nb_pixel_total : 13253 time to create 1 rle with old method : 0.015128612518310547 time for calcul the mask position with numpy : 0.03572440147399902 nb_pixel_total : 64154 time to create 1 rle with old method : 0.07305312156677246 time for calcul the mask position with numpy : 0.03454422950744629 nb_pixel_total : 1425 time to create 1 rle with old method : 0.0019421577453613281 time for calcul the mask position with numpy : 0.034674644470214844 nb_pixel_total : 96964 time to create 1 rle with old method : 0.10363006591796875 time for calcul the mask position with numpy : 0.03459525108337402 nb_pixel_total : 15095 time to create 1 rle with old method : 0.016354799270629883 time for calcul the mask position with numpy : 0.034066200256347656 nb_pixel_total : 828 time to create 1 rle with old method : 0.00124359130859375 time for calcul the mask position with numpy : 0.0343775749206543 nb_pixel_total : 135303 time to create 1 rle with old method : 0.14574694633483887 time for calcul the mask position with numpy : 0.03379034996032715 nb_pixel_total : 42250 time to create 1 rle with old method : 0.04540085792541504 time for calcul the mask position with numpy : 0.03894805908203125 nb_pixel_total : 16245 time to create 1 rle with old method : 0.025532007217407227 time for calcul the mask position with numpy : 0.03697633743286133 nb_pixel_total : 14734 time to create 1 rle with old method : 0.02033066749572754 time for calcul the mask position with numpy : 0.0390467643737793 nb_pixel_total : 9118 time to create 1 rle with old method : 0.014405012130737305 time for calcul the mask position with numpy : 0.03701901435852051 nb_pixel_total : 88560 time to create 1 rle with old method : 0.09862232208251953 time for calcul the mask position with numpy : 0.03373408317565918 nb_pixel_total : 53047 time to create 1 rle with old method : 0.05894160270690918 time for calcul the mask position with numpy : 0.03502798080444336 nb_pixel_total : 114025 time to create 1 rle with old method : 0.12120532989501953 time for calcul the mask position with numpy : 0.034058570861816406 nb_pixel_total : 20763 time to create 1 rle with old method : 0.024670839309692383 time for calcul the mask position with numpy : 0.036122798919677734 nb_pixel_total : 44685 time to create 1 rle with old method : 0.054107666015625 time for calcul the mask position with numpy : 0.0366666316986084 nb_pixel_total : 87675 time to create 1 rle with old method : 0.09543204307556152 time for calcul the mask position with numpy : 0.033678293228149414 nb_pixel_total : 36222 time to create 1 rle with old method : 0.03971672058105469 time for calcul the mask position with numpy : 0.034543752670288086 nb_pixel_total : 26747 time to create 1 rle with old method : 0.027800798416137695 create new chi : 4.168520212173462 time to delete rle : 0.001322031021118164 batch 1 Loaded 32 chid ids of type : 4211 Number RLEs to save : 16007 TO DO : save crop sub photo not yet done ! save time : 1.135434627532959 nb_obj : 26 nb_hashtags : 5 time to prepare the origin masks : 14.038550853729248 time for calcul the mask position with numpy : 0.5779757499694824 nb_pixel_total : 7135551 time to create 1 rle with new method : 0.628788948059082 time for calcul the mask position with numpy : 0.04061079025268555 nb_pixel_total : 30008 time to create 1 rle with old method : 0.032794952392578125 time for calcul the mask position with numpy : 0.03545069694519043 nb_pixel_total : 169345 time to create 1 rle with new method : 0.5937044620513916 time for calcul the mask position with numpy : 0.03516554832458496 nb_pixel_total : 68531 time to create 1 rle with old method : 0.06945180892944336 time for calcul the mask position with numpy : 0.033220767974853516 nb_pixel_total : 38424 time to create 1 rle with old method : 0.039739370346069336 time for calcul the mask position with numpy : 0.03245043754577637 nb_pixel_total : 27540 time to create 1 rle with old method : 0.02703714370727539 time for calcul the mask position with numpy : 0.03578066825866699 nb_pixel_total : 62238 time to create 1 rle with old method : 0.07740044593811035 time for calcul the mask position with numpy : 0.03501152992248535 nb_pixel_total : 13296 time to create 1 rle with old method : 0.015029191970825195 time for calcul the mask position with numpy : 0.03452610969543457 nb_pixel_total : 23659 time to create 1 rle with old method : 0.025844335556030273 time for calcul the mask position with numpy : 0.03361034393310547 nb_pixel_total : 30324 time to create 1 rle with old method : 0.03193044662475586 time for calcul the mask position with numpy : 0.03276944160461426 nb_pixel_total : 37393 time to create 1 rle with old method : 0.03903365135192871 time for calcul the mask position with numpy : 0.03358149528503418 nb_pixel_total : 30351 time to create 1 rle with old method : 0.03262138366699219 time for calcul the mask position with numpy : 0.033087968826293945 nb_pixel_total : 26322 time to create 1 rle with old method : 0.02747964859008789 time for calcul the mask position with numpy : 0.03308439254760742 nb_pixel_total : 85027 time to create 1 rle with old method : 0.08941411972045898 time for calcul the mask position with numpy : 0.03432106971740723 nb_pixel_total : 29446 time to create 1 rle with old method : 0.03169441223144531 time for calcul the mask position with numpy : 0.03374314308166504 nb_pixel_total : 43968 time to create 1 rle with old method : 0.04466366767883301 time for calcul the mask position with numpy : 0.033117055892944336 nb_pixel_total : 120056 time to create 1 rle with old method : 0.12458062171936035 time for calcul the mask position with numpy : 0.03282785415649414 nb_pixel_total : 91475 time to create 1 rle with old method : 0.09143877029418945 time for calcul the mask position with numpy : 0.031575679779052734 nb_pixel_total : 9005 time to create 1 rle with old method : 0.008675098419189453 time for calcul the mask position with numpy : 0.03181004524230957 nb_pixel_total : 12036 time to create 1 rle with old method : 0.012274742126464844 time for calcul the mask position with numpy : 0.03193235397338867 nb_pixel_total : 3434 time to create 1 rle with old method : 0.003772258758544922 time for calcul the mask position with numpy : 0.03313040733337402 nb_pixel_total : 40524 time to create 1 rle with old method : 0.039594411849975586 time for calcul the mask position with numpy : 0.03356504440307617 nb_pixel_total : 57337 time to create 1 rle with old method : 0.05954456329345703 time for calcul the mask position with numpy : 0.03208112716674805 nb_pixel_total : 26663 time to create 1 rle with old method : 0.02751445770263672 time for calcul the mask position with numpy : 0.03240180015563965 nb_pixel_total : 8 time to create 1 rle with old method : 0.000152587890625 time for calcul the mask position with numpy : 0.03226161003112793 nb_pixel_total : 32494 time to create 1 rle with old method : 0.03141474723815918 time for calcul the mask position with numpy : 0.03244495391845703 nb_pixel_total : 49945 time to create 1 rle with old method : 0.050974130630493164 create new chi : 3.799067974090576 time to delete rle : 0.0013649463653564453 batch 1 Loaded 27 chid ids of type : 4211 Number RLEs to save : 14394 TO DO : save crop sub photo not yet done ! save time : 0.758385419845581 nb_obj : 27 nb_hashtags : 6 time to prepare the origin masks : 12.505450010299683 time for calcul the mask position with numpy : 0.23867440223693848 nb_pixel_total : 7067895 time to create 1 rle with new method : 1.0547740459442139 time for calcul the mask position with numpy : 0.03498435020446777 nb_pixel_total : 22418 time to create 1 rle with old method : 0.02506399154663086 time for calcul the mask position with numpy : 0.03524613380432129 nb_pixel_total : 60373 time to create 1 rle with old method : 0.07003664970397949 time for calcul the mask position with numpy : 0.039313316345214844 nb_pixel_total : 44338 time to create 1 rle with old method : 0.04994535446166992 time for calcul the mask position with numpy : 0.07181906700134277 nb_pixel_total : 56544 time to create 1 rle with old method : 0.06352901458740234 time for calcul the mask position with numpy : 0.03535747528076172 nb_pixel_total : 30461 time to create 1 rle with old method : 0.03450131416320801 time for calcul the mask position with numpy : 0.0355684757232666 nb_pixel_total : 37223 time to create 1 rle with old method : 0.04310107231140137 time for calcul the mask position with numpy : 0.03380250930786133 nb_pixel_total : 35850 time to create 1 rle with old method : 0.038515567779541016 time for calcul the mask position with numpy : 0.032469987869262695 nb_pixel_total : 19587 time to create 1 rle with old method : 0.019969940185546875 time for calcul the mask position with numpy : 0.03401899337768555 nb_pixel_total : 76963 time to create 1 rle with old method : 0.07928109169006348 time for calcul the mask position with numpy : 0.03336811065673828 nb_pixel_total : 49806 time to create 1 rle with old method : 0.051587820053100586 time for calcul the mask position with numpy : 0.03284001350402832 nb_pixel_total : 15719 time to create 1 rle with old method : 0.017217159271240234 time for calcul the mask position with numpy : 0.032819509506225586 nb_pixel_total : 19449 time to create 1 rle with old method : 0.019694805145263672 time for calcul the mask position with numpy : 0.03317070007324219 nb_pixel_total : 49366 time to create 1 rle with old method : 0.0518801212310791 time for calcul the mask position with numpy : 0.03407859802246094 nb_pixel_total : 71712 time to create 1 rle with old method : 0.07450485229492188 time for calcul the mask position with numpy : 0.033724308013916016 nb_pixel_total : 702 time to create 1 rle with old method : 0.0007951259613037109 time for calcul the mask position with numpy : 0.03383827209472656 nb_pixel_total : 57982 time to create 1 rle with old method : 0.06186485290527344 time for calcul the mask position with numpy : 0.03304910659790039 nb_pixel_total : 38663 time to create 1 rle with old method : 0.04104137420654297 time for calcul the mask position with numpy : 0.03418135643005371 nb_pixel_total : 130467 time to create 1 rle with old method : 0.13978290557861328 time for calcul the mask position with numpy : 0.03299450874328613 nb_pixel_total : 51577 time to create 1 rle with old method : 0.05527615547180176 time for calcul the mask position with numpy : 0.03263711929321289 nb_pixel_total : 22011 time to create 1 rle with old method : 0.0223085880279541 time for calcul the mask position with numpy : 0.033158302307128906 nb_pixel_total : 4520 time to create 1 rle with old method : 0.005288839340209961 time for calcul the mask position with numpy : 0.03717851638793945 nb_pixel_total : 25652 time to create 1 rle with old method : 0.028849124908447266 time for calcul the mask position with numpy : 0.034629106521606445 nb_pixel_total : 65611 time to create 1 rle with old method : 0.06923604011535645 time for calcul the mask position with numpy : 0.03336381912231445 nb_pixel_total : 63189 time to create 1 rle with old method : 0.06894826889038086 time for calcul the mask position with numpy : 0.03409743309020996 nb_pixel_total : 55051 time to create 1 rle with old method : 0.05679154396057129 time for calcul the mask position with numpy : 0.03395557403564453 nb_pixel_total : 76050 time to create 1 rle with old method : 0.0780029296875 time for calcul the mask position with numpy : 0.0338897705078125 nb_pixel_total : 45221 time to create 1 rle with old method : 0.04880118370056152 create new chi : 3.6074910163879395 time to delete rle : 0.0021877288818359375 batch 1 Loaded 28 chid ids of type : 4211 Number RLEs to save : 15904 TO DO : save crop sub photo not yet done ! save time : 0.8642809391021729 nb_obj : 27 nb_hashtags : 7 time to prepare the origin masks : 11.948774337768555 time for calcul the mask position with numpy : 0.46974635124206543 nb_pixel_total : 7010028 time to create 1 rle with new method : 0.7595627307891846 time for calcul the mask position with numpy : 0.03336763381958008 nb_pixel_total : 10466 time to create 1 rle with old method : 0.010403871536254883 time for calcul the mask position with numpy : 0.03294563293457031 nb_pixel_total : 14170 time to create 1 rle with old method : 0.014728069305419922 time for calcul the mask position with numpy : 0.033060550689697266 nb_pixel_total : 23536 time to create 1 rle with old method : 0.023785829544067383 time for calcul the mask position with numpy : 0.033408164978027344 nb_pixel_total : 43286 time to create 1 rle with old method : 0.04463005065917969 time for calcul the mask position with numpy : 0.032991886138916016 nb_pixel_total : 55594 time to create 1 rle with old method : 0.060915470123291016 time for calcul the mask position with numpy : 0.03388833999633789 nb_pixel_total : 75627 time to create 1 rle with old method : 0.07794475555419922 time for calcul the mask position with numpy : 0.03398537635803223 nb_pixel_total : 130672 time to create 1 rle with old method : 0.13419079780578613 time for calcul the mask position with numpy : 0.03376317024230957 nb_pixel_total : 41763 time to create 1 rle with old method : 0.04929041862487793 time for calcul the mask position with numpy : 0.033861637115478516 nb_pixel_total : 12551 time to create 1 rle with old method : 0.013274908065795898 time for calcul the mask position with numpy : 0.03860163688659668 nb_pixel_total : 58818 time to create 1 rle with old method : 0.05923724174499512 time for calcul the mask position with numpy : 0.033380985260009766 nb_pixel_total : 54547 time to create 1 rle with old method : 0.05517411231994629 time for calcul the mask position with numpy : 0.03275179862976074 nb_pixel_total : 55812 time to create 1 rle with old method : 0.05904793739318848 time for calcul the mask position with numpy : 0.03307318687438965 nb_pixel_total : 122260 time to create 1 rle with old method : 0.13301372528076172 time for calcul the mask position with numpy : 0.033951520919799805 nb_pixel_total : 14591 time to create 1 rle with old method : 0.02287602424621582 time for calcul the mask position with numpy : 0.038829803466796875 nb_pixel_total : 85597 time to create 1 rle with old method : 0.09540581703186035 time for calcul the mask position with numpy : 0.03325033187866211 nb_pixel_total : 19753 time to create 1 rle with old method : 0.020062923431396484 time for calcul the mask position with numpy : 0.03206896781921387 nb_pixel_total : 86647 time to create 1 rle with old method : 0.09226012229919434 time for calcul the mask position with numpy : 0.033403635025024414 nb_pixel_total : 35766 time to create 1 rle with old method : 0.03908419609069824 time for calcul the mask position with numpy : 0.03423595428466797 nb_pixel_total : 64009 time to create 1 rle with old method : 0.06920909881591797 time for calcul the mask position with numpy : 0.03184342384338379 nb_pixel_total : 4994 time to create 1 rle with old method : 0.004911661148071289 time for calcul the mask position with numpy : 0.031960248947143555 nb_pixel_total : 64835 time to create 1 rle with old method : 0.06870412826538086 time for calcul the mask position with numpy : 0.033040523529052734 nb_pixel_total : 20938 time to create 1 rle with old method : 0.02091217041015625 time for calcul the mask position with numpy : 0.03292965888977051 nb_pixel_total : 56045 time to create 1 rle with old method : 0.058493852615356445 time for calcul the mask position with numpy : 0.0336153507232666 nb_pixel_total : 14055 time to create 1 rle with old method : 0.014516353607177734 time for calcul the mask position with numpy : 0.03338122367858887 nb_pixel_total : 68628 time to create 1 rle with old method : 0.0745086669921875 time for calcul the mask position with numpy : 0.03199625015258789 nb_pixel_total : 40231 time to create 1 rle with old method : 0.04138350486755371 time for calcul the mask position with numpy : 0.03393101692199707 nb_pixel_total : 9181 time to create 1 rle with old method : 0.010124444961547852 create new chi : 3.5419816970825195 time to delete rle : 0.0015516281127929688 batch 1 Loaded 28 chid ids of type : 4211 Number RLEs to save : 16961 TO DO : save crop sub photo not yet done ! save time : 0.9045331478118896 nb_obj : 29 nb_hashtags : 7 time to prepare the origin masks : 12.643142223358154 time for calcul the mask position with numpy : 0.4015178680419922 nb_pixel_total : 6923652 time to create 1 rle with new method : 0.765291690826416 time for calcul the mask position with numpy : 0.03399848937988281 nb_pixel_total : 66309 time to create 1 rle with old method : 0.0720667839050293 time for calcul the mask position with numpy : 0.033121585845947266 nb_pixel_total : 8085 time to create 1 rle with old method : 0.00882411003112793 time for calcul the mask position with numpy : 0.03300309181213379 nb_pixel_total : 54388 time to create 1 rle with old method : 0.05475640296936035 time for calcul the mask position with numpy : 0.03325319290161133 nb_pixel_total : 94411 time to create 1 rle with old method : 0.09616780281066895 time for calcul the mask position with numpy : 0.033295392990112305 nb_pixel_total : 76348 time to create 1 rle with old method : 0.0769801139831543 time for calcul the mask position with numpy : 0.03306245803833008 nb_pixel_total : 26264 time to create 1 rle with old method : 0.028312206268310547 time for calcul the mask position with numpy : 0.035033464431762695 nb_pixel_total : 55246 time to create 1 rle with old method : 0.08064055442810059 time for calcul the mask position with numpy : 0.03481698036193848 nb_pixel_total : 145467 time to create 1 rle with old method : 0.1540071964263916 time for calcul the mask position with numpy : 0.03351712226867676 nb_pixel_total : 36205 time to create 1 rle with old method : 0.03760242462158203 time for calcul the mask position with numpy : 0.03429460525512695 nb_pixel_total : 30334 time to create 1 rle with old method : 0.03264164924621582 time for calcul the mask position with numpy : 0.034401655197143555 nb_pixel_total : 38839 time to create 1 rle with old method : 0.04035377502441406 time for calcul the mask position with numpy : 0.03285622596740723 nb_pixel_total : 41393 time to create 1 rle with old method : 0.043289899826049805 time for calcul the mask position with numpy : 0.03330659866333008 nb_pixel_total : 7361 time to create 1 rle with old method : 0.0076143741607666016 time for calcul the mask position with numpy : 0.03336763381958008 nb_pixel_total : 25410 time to create 1 rle with old method : 0.026410579681396484 time for calcul the mask position with numpy : 0.031925201416015625 nb_pixel_total : 20289 time to create 1 rle with old method : 0.020695924758911133 time for calcul the mask position with numpy : 0.03291201591491699 nb_pixel_total : 65407 time to create 1 rle with old method : 0.06983423233032227 time for calcul the mask position with numpy : 0.0330045223236084 nb_pixel_total : 22219 time to create 1 rle with old method : 0.02346181869506836 time for calcul the mask position with numpy : 0.032967567443847656 nb_pixel_total : 62335 time to create 1 rle with old method : 0.06088662147521973 time for calcul the mask position with numpy : 0.032256364822387695 nb_pixel_total : 105503 time to create 1 rle with old method : 0.1305985450744629 time for calcul the mask position with numpy : 0.035774946212768555 nb_pixel_total : 24349 time to create 1 rle with old method : 0.025912046432495117 time for calcul the mask position with numpy : 0.033678531646728516 nb_pixel_total : 74909 time to create 1 rle with old method : 0.07921814918518066 time for calcul the mask position with numpy : 0.032448530197143555 nb_pixel_total : 2002 time to create 1 rle with old method : 0.002202749252319336 time for calcul the mask position with numpy : 0.032857418060302734 nb_pixel_total : 545 time to create 1 rle with old method : 0.0007598400115966797 time for calcul the mask position with numpy : 0.0326385498046875 nb_pixel_total : 54377 time to create 1 rle with old method : 0.05685853958129883 time for calcul the mask position with numpy : 0.03329873085021973 nb_pixel_total : 30165 time to create 1 rle with old method : 0.030144453048706055 time for calcul the mask position with numpy : 0.03271174430847168 nb_pixel_total : 65526 time to create 1 rle with old method : 0.06677365303039551 time for calcul the mask position with numpy : 0.033669471740722656 nb_pixel_total : 36770 time to create 1 rle with old method : 0.03794050216674805 time for calcul the mask position with numpy : 0.03321123123168945 nb_pixel_total : 59236 time to create 1 rle with old method : 0.059653520584106445 time for calcul the mask position with numpy : 0.03228139877319336 nb_pixel_total : 41056 time to create 1 rle with old method : 0.041643619537353516 create new chi : 3.6388208866119385 time to delete rle : 0.001789093017578125 batch 1 Loaded 30 chid ids of type : 4211 Number RLEs to save : 16776 TO DO : save crop sub photo not yet done ! save time : 0.9007260799407959 nb_obj : 21 nb_hashtags : 8 time to prepare the origin masks : 15.83992075920105 time for calcul the mask position with numpy : 0.49437713623046875 nb_pixel_total : 7104114 time to create 1 rle with new method : 0.9004278182983398 time for calcul the mask position with numpy : 0.04624652862548828 nb_pixel_total : 46412 time to create 1 rle with old method : 0.049073219299316406 time for calcul the mask position with numpy : 0.04333972930908203 nb_pixel_total : 31703 time to create 1 rle with old method : 0.04875755310058594 time for calcul the mask position with numpy : 0.04024314880371094 nb_pixel_total : 103882 time to create 1 rle with old method : 0.10457348823547363 time for calcul the mask position with numpy : 0.043260812759399414 nb_pixel_total : 132981 time to create 1 rle with old method : 0.14303970336914062 time for calcul the mask position with numpy : 0.0404200553894043 nb_pixel_total : 40144 time to create 1 rle with old method : 0.04354429244995117 time for calcul the mask position with numpy : 0.03834199905395508 nb_pixel_total : 25817 time to create 1 rle with old method : 0.02580094337463379 time for calcul the mask position with numpy : 0.03730273246765137 nb_pixel_total : 146451 time to create 1 rle with old method : 0.1554105281829834 time for calcul the mask position with numpy : 0.038053035736083984 nb_pixel_total : 44778 time to create 1 rle with old method : 0.04593324661254883 time for calcul the mask position with numpy : 0.03933310508728027 nb_pixel_total : 50066 time to create 1 rle with old method : 0.05471038818359375 time for calcul the mask position with numpy : 0.037355661392211914 nb_pixel_total : 53743 time to create 1 rle with old method : 0.05757570266723633 time for calcul the mask position with numpy : 0.03908681869506836 nb_pixel_total : 15213 time to create 1 rle with old method : 0.016576766967773438 time for calcul the mask position with numpy : 0.03820991516113281 nb_pixel_total : 90164 time to create 1 rle with old method : 0.08950138092041016 time for calcul the mask position with numpy : 0.02568793296813965 nb_pixel_total : 79249 time to create 1 rle with old method : 0.08520936965942383 time for calcul the mask position with numpy : 0.025563716888427734 nb_pixel_total : 68562 time to create 1 rle with old method : 0.0704197883605957 time for calcul the mask position with numpy : 0.025492191314697266 nb_pixel_total : 43543 time to create 1 rle with old method : 0.04562973976135254 time for calcul the mask position with numpy : 0.024880647659301758 nb_pixel_total : 45052 time to create 1 rle with old method : 0.04668688774108887 time for calcul the mask position with numpy : 0.025675296783447266 nb_pixel_total : 40752 time to create 1 rle with old method : 0.04205131530761719 time for calcul the mask position with numpy : 0.02362203598022461 nb_pixel_total : 26481 time to create 1 rle with old method : 0.027086734771728516 time for calcul the mask position with numpy : 0.02453160285949707 nb_pixel_total : 36883 time to create 1 rle with old method : 0.036893367767333984 time for calcul the mask position with numpy : 0.02313709259033203 nb_pixel_total : 31433 time to create 1 rle with old method : 0.030373334884643555 time for calcul the mask position with numpy : 0.02294015884399414 nb_pixel_total : 36977 time to create 1 rle with old method : 0.03759574890136719 create new chi : 3.407400608062744 time to delete rle : 0.0017576217651367188 batch 1 Loaded 22 chid ids of type : 4211 Number RLEs to save : 15230 TO DO : save crop sub photo not yet done ! save time : 0.8213217258453369 map_output_result : {1333211566: (0.0, 'Should be the crop_list due to order', 0.0), 1333211559: (0.0, 'Should be the crop_list due to order', 0.0), 1333211553: (0.0, 'Should be the crop_list due to order', 0.0), 1333211539: (0.0, 'Should be the crop_list due to order', 0.0), 1333211511: (0.0, 'Should be the crop_list due to order', 0.0), 1333211507: (0.0, 'Should be the crop_list due to order', 0.0), 1333211502: (0.0, 'Should be the crop_list due to order', 0.0), 1333211499: (0.0, 'Should be the crop_list due to order', 0.0), 1333211467: (0.0, 'Should be the crop_list due to order', 0.0), 1333211400: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1333211566, 1333211559, 1333211553, 1333211539, 1333211511, 1333211507, 1333211502, 1333211499, 1333211467, 1333211400] Looping around the photos to save general results len do output : 10 /1333211566.Didn't retrieve data . /1333211559.Didn't retrieve data . /1333211553.Didn't retrieve data . /1333211539.Didn't retrieve data . /1333211511.Didn't retrieve data . /1333211507.Didn't retrieve data . /1333211502.Didn't retrieve data . /1333211499.Didn't retrieve data . /1333211467.Didn't retrieve data . /1333211400.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211566', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211559', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211553', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211539', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211511', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211507', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211502', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211499', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211467', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211400', None, None, None, None, None, '2532921') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.014093399047851562 save_final save missing photos in datou_result : time spend for datou_step_exec : 185.80836057662964 time spend to save output : 0.01475381851196289 total time spend for step 8 : 185.8231143951416 step9:crop_condition Sat Feb 1 07:44:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4211 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 264 chid ids of type : 4211 begin to crop the class : barquette_opaque param for this class : {'min_score': 0.5} filtre for class : barquette_opaque hashtag_id of this class : 2107760128 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 4869462 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738392302_3674520 we have uploaded 14 photos in the portfolio 4869462 time of upload the photos Elapsed time : 4.630853176116943 we have finished the crop for the class : barquette_opaque begin to crop the class : carton param for this class : {'min_score': 0.5} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 4869462 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738392314_3674520 we have uploaded 26 photos in the portfolio 4869462 time of upload the photos Elapsed time : 6.0157389640808105 we have finished the crop for the class : carton begin to crop the class : ela param for this class : {'min_score': 0.5} filtre for class : ela hashtag_id of this class : 492741797 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 4869462 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738392322_3674520 we have uploaded 3 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.3106741905212402 we have finished the crop for the class : ela begin to crop the class : environnement param for this class : {'min_score': 0.5} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738392325_3674520 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.9664921760559082 we have finished the crop for the class : environnement begin to crop the class : etiquette param for this class : {'min_score': 0.5} filtre for class : etiquette hashtag_id of this class : 492636447 begin to crop the class : film_plastique param for this class : {'min_score': 0.5} filtre for class : film_plastique hashtag_id of this class : 2107756122 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 4869462 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738392332_3674520 we have uploaded 10 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.5048301219940186 we have finished the crop for the class : film_plastique begin to crop the class : kraft param for this class : {'min_score': 0.5} filtre for class : kraft hashtag_id of this class : 493202403 begin to crop the class : metal param for this class : {'min_score': 0.5} filtre for class : metal hashtag_id of this class : 492628673 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738392336_3674520 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.5377101898193359 we have finished the crop for the class : metal begin to crop the class : pehd param for this class : {'min_score': 0.5} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 46 About to insert : list_path_to_insert length 46 new photo from crops ! About to upload 46 photos upload in portfolio : 4869462 init cache_photo without model_param we have 46 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738392632_3674520 we have uploaded 46 photos in the portfolio 4869462 time of upload the photos Elapsed time : 13.927638530731201 we have finished the crop for the class : pehd begin to crop the class : pet_clair param for this class : {'min_score': 0.5} filtre for class : pet_clair hashtag_id of this class : 2107755846 begin to crop the class : pet_opaque param for this class : {'min_score': 0.5} filtre for class : pet_opaque hashtag_id of this class : 2107759152 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738392649_3674520 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.6183180809020996 we have finished the crop for the class : pet_opaque begin to crop the class : textiles_sanitaires param for this class : {'min_score': 0.5} filtre for class : textiles_sanitaires hashtag_id of this class : 2107760129 begin to crop the class : pet_fonce param for this class : {'min_score': 0.5} filtre for class : pet_fonce hashtag_id of this class : 2107755900 begin to crop the class : papier param for this class : {'min_score': 0.5} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 43 About to insert : list_path_to_insert length 43 new photo from crops ! About to upload 43 photos upload in portfolio : 4869462 init cache_photo without model_param we have 43 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738392661_3674520 we have uploaded 43 photos in the portfolio 4869462 time of upload the photos Elapsed time : 10.759066104888916 we have finished the crop for the class : papier delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1333211566, 1333211559, 1333211553, 1333211539, 1333211511, 1333211507, 1333211502, 1333211499, 1333211467, 1333211400] Looping around the photos to save general results len do output : 145 /1333632078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333632182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333633349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211566', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211559', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211553', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211539', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211511', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211507', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211502', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211499', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211467', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211400', None, None, None, None, None, '2532921') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 445 time used for this insertion : 0.04418587684631348 save_final save missing photos in datou_result : time spend for datou_step_exec : 377.561176776886 time spend to save output : 0.04734992980957031 total time spend for step 9 : 377.60852670669556 step10:ventilate_hashtags_in_portfolio Sat Feb 1 07:51:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20101919 get user id for portfolio 20101919 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20101919 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','pet_fonce','ela','papier','barquette_opaque','pet_opaque','flou','etiquette','film_plastique','kraft','textiles_sanitaires','metal','environnement','carton','mal_croppe','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20101919 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','pet_fonce','ela','papier','barquette_opaque','pet_opaque','flou','etiquette','film_plastique','kraft','textiles_sanitaires','metal','environnement','carton','mal_croppe','pet_clair')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20101919 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','pet_fonce','ela','papier','barquette_opaque','pet_opaque','flou','etiquette','film_plastique','kraft','textiles_sanitaires','metal','environnement','carton','mal_croppe','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/20137450,20137451,20137452,20137453,20137454,20137455,20137456,20137457,20137458,20137459,20137460,20137461,20137462,20137463,20137464,20137465?tags=pehd,pet_fonce,ela,papier,barquette_opaque,pet_opaque,flou,etiquette,film_plastique,kraft,textiles_sanitaires,metal,environnement,carton,mal_croppe,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1333211566, 1333211559, 1333211553, 1333211539, 1333211511, 1333211507, 1333211502, 1333211499, 1333211467, 1333211400] Looping around the photos to save general results len do output : 1 /20101919. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211566', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211559', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211553', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211539', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211511', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211507', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211502', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211499', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211467', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211400', None, None, None, None, None, '2532921') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.014392375946044922 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.469247579574585 time spend to save output : 0.017928361892700195 total time spend for step 10 : 1.4871759414672852 step11:final Sat Feb 1 07:51:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1333211566: ('0.05287270485910655',), 1333211559: ('0.05287270485910655',), 1333211553: ('0.05287270485910655',), 1333211539: ('0.05287270485910655',), 1333211511: ('0.05287270485910655',), 1333211507: ('0.05287270485910655',), 1333211502: ('0.05287270485910655',), 1333211499: ('0.05287270485910655',), 1333211467: ('0.05287270485910655',), 1333211400: ('0.05287270485910655',)} new output for save of step final : {1333211566: ('0.05287270485910655',), 1333211559: ('0.05287270485910655',), 1333211553: ('0.05287270485910655',), 1333211539: ('0.05287270485910655',), 1333211511: ('0.05287270485910655',), 1333211507: ('0.05287270485910655',), 1333211502: ('0.05287270485910655',), 1333211499: ('0.05287270485910655',), 1333211467: ('0.05287270485910655',), 1333211400: ('0.05287270485910655',)} [1333211566, 1333211559, 1333211553, 1333211539, 1333211511, 1333211507, 1333211502, 1333211499, 1333211467, 1333211400] Looping around the photos to save general results len do output : 10 /1333211566.Didn't retrieve data . /1333211559.Didn't retrieve data . /1333211553.Didn't retrieve data . /1333211539.Didn't retrieve data . /1333211511.Didn't retrieve data . /1333211507.Didn't retrieve data . /1333211502.Didn't retrieve data . /1333211499.Didn't retrieve data . /1333211467.Didn't retrieve data . /1333211400.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211566', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211559', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211553', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211539', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211511', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211507', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211502', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211499', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211467', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211400', None, None, None, None, None, '2532921') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.01393890380859375 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.09876108169555664 time spend to save output : 0.014417409896850586 total time spend for step 11 : 0.11317849159240723 step12:velours_tree Sat Feb 1 07:51:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.05512094497680664 time spend to save output : 4.839897155761719e-05 total time spend for step 12 : 0.05516934394836426 step13:send_mail_cod Sat Feb 1 07:51:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P20101919_01-02-2025_07_51_14.pdf 20137451 imagette201374511738392674 20137452 change filename to text .change filename to text .change filename to text .imagette201374521738392674 20137453 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201374531738392674 20137454 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201374541738392676 20137455 change filename to text .imagette201374551738392677 20137456 imagette201374561738392677 20137457 imagette201374571738392677 20137458 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201374581738392677 20137459 imagette201374591738392678 20137460 imagette201374601738392678 20137461 change filename to text .imagette201374611738392678 20137463 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201374631738392678 20137464 imagette201374641738392679 20137465 imagette201374651738392679 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20101919 and hashtag_type = 4211 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20137450,20137451,20137452,20137453,20137454,20137455,20137456,20137457,20137458,20137459,20137460,20137461,20137462,20137463,20137464,20137465?tags=pehd,pet_fonce,ela,papier,barquette_opaque,pet_opaque,flou,etiquette,film_plastique,kraft,textiles_sanitaires,metal,environnement,carton,mal_croppe,pet_clair your option no_mail is active, we will not send the real mail to your client args[1333211566] : ((1333211566, -5.344207340329601, 492609224), (1333211566, -0.05050833460793872, 2107752395), '0.05287270485910655') We are sending mail with results at report@fotonower.com args[1333211559] : ((1333211559, -3.076831041716178, 492609224), (1333211559, -1.9522844757026825, 501862349), '0.05287270485910655') We are sending mail with results at report@fotonower.com args[1333211553] : ((1333211553, -5.226019639275802, 492609224), (1333211553, -0.1915249330890221, 496442774), '0.05287270485910655') We are sending mail with results at report@fotonower.com args[1333211539] : ((1333211539, -5.184819310063557, 492609224), (1333211539, -0.2921318750761867, 496442774), '0.05287270485910655') We are sending mail with results at report@fotonower.com args[1333211511] : ((1333211511, -4.606382681937619, 492609224), (1333211511, -0.5820211204814603, 501862349), '0.05287270485910655') We are sending mail with results at report@fotonower.com args[1333211507] : ((1333211507, -5.416588196015146, 492609224), (1333211507, -0.20097722270708634, 496442774), '0.05287270485910655') We are sending mail with results at report@fotonower.com args[1333211502] : ((1333211502, -5.010817445230512, 492609224), (1333211502, -0.1652789223304215, 496442774), '0.05287270485910655') We are sending mail with results at report@fotonower.com args[1333211499] : ((1333211499, -5.195382579984201, 492609224), (1333211499, 0.2802288116870879, 2107752395), '0.05287270485910655') We are sending mail with results at report@fotonower.com args[1333211467] : ((1333211467, -5.216023207989471, 492609224), (1333211467, 0.013221833929987095, 2107752395), '0.05287270485910655') We are sending mail with results at report@fotonower.com args[1333211400] : ((1333211400, -5.192312048549492, 492609224), (1333211400, 0.12133844283763835, 2107752395), '0.05287270485910655') We are sending mail with results at report@fotonower.com refus_total : 0.05287270485910655 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20101919 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20101919_01-02-2025_07_51_14.pdf results_Auto_P20101919_01-02-2025_07_51_14.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20101919_01-02-2025_07_51_14.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4909','20101919','results_Auto_P20101919_01-02-2025_07_51_14.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20101919_01-02-2025_07_51_14.pdf','pdf','','0.8','0.05287270485910655') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1333211566, 1333211559, 1333211553, 1333211539, 1333211511, 1333211507, 1333211502, 1333211499, 1333211467, 1333211400] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211566', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211559', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211553', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211539', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211511', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211507', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211502', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211499', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211467', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211400', None, None, None, None, None, '2532921') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.01304316520690918 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.0381810665130615 time spend to save output : 0.013230562210083008 total time spend for step 13 : 7.0514116287231445 step14:split_time_score Sat Feb 1 07:51:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('05', 23),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 31012025 20101919 Nombre de photos uploadées : 23 / 23040 (0%) 31012025 20101919 Nombre de photos taguées (types de déchets): 0 / 23 (0%) 31012025 20101919 Nombre de photos taguées (volume) : 0 / 23 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 6.198883056640625e-06 ??????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.001146554946899414 elapsed_time : insert_dashboard_record_day_entry 0.0235745906829834 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.048317269335161735 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20101894_31-01-2025_17_32_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20101894 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20101894 AND mptpi.`type`=4207 To do Qualite : 0.048317269335161735 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20101894_31-01-2025_17_32_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20101894 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20101894 AND mptpi.`type`=4207 To do Qualite : 0.05287270485910655 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20101919_01-02-2025_07_51_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20101919 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20101919 AND mptpi.`type`=4211 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20102661 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20102662 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20102663 order by id desc limit 1 Qualite : 0.08902786066502703 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20102664_31-01-2025_07_49_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20102664 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20102664 AND mptpi.`type`=3594 To do Qualite : 0.011035329105844602 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116898_31-01-2025_21_11_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116898 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116898 AND mptpi.`type`=3327 To do Qualite : 0.0532787592474673 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20104699_31-01-2025_09_13_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20104699 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20104699 AND mptpi.`type`=4207 To do Qualite : 0.0532787592474673 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20104699_31-01-2025_09_13_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20104699 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20104699 AND mptpi.`type`=4207 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20104700 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20104703 order by id desc limit 1 Qualite : 0.04450619643594172 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20104704_31-01-2025_09_13_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20104704 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20104704 AND mptpi.`type`=4200 To do Qualite : 0.0389150612957706 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20104705_31-01-2025_09_05_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20104705 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20104705 AND mptpi.`type`=4207 To do Qualite : 0.0389150612957706 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20104705_31-01-2025_09_05_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20104705 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20104705 AND mptpi.`type`=4207 To do Qualite : 0.06518677425271137 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20105987_01-02-2025_07_06_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20105987 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20105987 AND mptpi.`type`=4211 To do Qualite : 0.062131594056886036 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20105988_31-01-2025_09_31_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20105988 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20105988 AND mptpi.`type`=4207 To do Qualite : 0.062131594056886036 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20105988_31-01-2025_09_31_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20105988 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20105988 AND mptpi.`type`=4207 To do Qualite : 0.04592298383232604 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20105989_31-01-2025_09_44_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20105989 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20105989 AND mptpi.`type`=4200 To do Qualite : 0.021323584062132642 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20106006_01-02-2025_06_04_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106006 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20106006 AND mptpi.`type`=3327 To do Qualite : 0.0659760195972663 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20106007_01-02-2025_06_54_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106007 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20106007 AND mptpi.`type`=4211 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116899 order by id desc limit 1 Qualite : 0.07669007200777468 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20108230_31-01-2025_14_04_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108230 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20108230 AND mptpi.`type`=4207 To do Qualite : 0.07669007200777468 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20108230_31-01-2025_14_04_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108230 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20108230 AND mptpi.`type`=4207 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108232 order by id desc limit 1 Qualite : 0.04172691062774052 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20108234_01-02-2025_06_57_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108234 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20108234 AND mptpi.`type`=4211 To do Qualite : 0.039392854453661925 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20108235_31-01-2025_10_21_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108235 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20108235 AND mptpi.`type`=3726 To do Qualite : 0.0476585190222166 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20108236_31-01-2025_13_40_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108236 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20108236 AND mptpi.`type`=4200 To do Qualite : 0.06450243762976816 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20110612_31-01-2025_11_46_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110612 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110612 AND mptpi.`type`=4207 To do Qualite : 0.06450243762976816 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20110612_31-01-2025_11_46_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110612 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110612 AND mptpi.`type`=4207 To do Qualite : 0.049907224850733796 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20110615_31-01-2025_11_35_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110615 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110615 AND mptpi.`type`=4207 To do Qualite : 0.049907224850733796 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20110615_31-01-2025_11_35_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110615 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110615 AND mptpi.`type`=4207 To do Qualite : 0.03257315850760986 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20110617_01-02-2025_05_51_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110617 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110617 AND mptpi.`type`=3327 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110620 order by id desc limit 1 Qualite : 0.04871923513455589 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20110622_31-01-2025_11_54_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110622 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110622 AND mptpi.`type`=4200 To do Qualite : 0.05783960199992943 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116388_31-01-2025_15_28_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116388 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116388 AND mptpi.`type`=4207 To do Qualite : 0.05783960199992943 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116388_31-01-2025_15_28_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116388 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116388 AND mptpi.`type`=4207 To do Qualite : 0.05078932470128937 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20115463_31-01-2025_15_09_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115463 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20115463 AND mptpi.`type`=4211 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113518 order by id desc limit 1 Qualite : 0.046050081756076854 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20113520_31-01-2025_13_19_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113520 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20113520 AND mptpi.`type`=4200 To do Qualite : 0.06408477493466957 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20113522_31-01-2025_13_25_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113522 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20113522 AND mptpi.`type`=4211 To do Qualite : 0.039927772457590216 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20113524_31-01-2025_12_36_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113524 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20113524 AND mptpi.`type`=3726 To do Qualite : 0.061467324636990894 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20113526_31-01-2025_13_02_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113526 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20113526 AND mptpi.`type`=4207 To do Qualite : 0.061467324636990894 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20113526_31-01-2025_13_02_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113526 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20113526 AND mptpi.`type`=4207 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115132 order by id desc limit 1 Qualite : 0.05921587136666769 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20115133_31-01-2025_14_17_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115133 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20115133 AND mptpi.`type`=4200 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115134 order by id desc limit 1 Qualite : 0.08455509921512683 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20115464_31-01-2025_14_08_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115464 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20115464 AND mptpi.`type`=4207 To do Qualite : 0.08455509921512683 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20115464_31-01-2025_14_08_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115464 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20115464 AND mptpi.`type`=4207 To do Qualite : 0.011256581107159599 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20115465_01-02-2025_01_13_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115465 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20115465 AND mptpi.`type`=3327 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115466 order by id desc limit 1 Qualite : 0.07518493725304869 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20115467_31-01-2025_14_03_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115467 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20115467 AND mptpi.`type`=4207 To do Qualite : 0.07518493725304869 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20115467_31-01-2025_14_03_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115467 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20115467 AND mptpi.`type`=4207 To do Qualite : 0.027086503302507146 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116389_31-01-2025_15_07_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116389 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116389 AND mptpi.`type`=3726 To do Qualite : 0.056621078236339516 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116390_31-01-2025_15_25_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116390 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116390 AND mptpi.`type`=4200 To do Qualite : 0.051673272292095285 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116391_31-01-2025_15_20_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116391 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116391 AND mptpi.`type`=4207 To do Qualite : 0.051673272292095285 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116391_31-01-2025_15_20_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116391 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116391 AND mptpi.`type`=4207 To do Qualite : 0.06867978753776505 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116392_31-01-2025_18_36_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116392 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116392 AND mptpi.`type`=4211 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116393 order by id desc limit 1 Qualite : 0.007176973093388443 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116900_31-01-2025_18_35_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116900 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116900 AND mptpi.`type`=3327 To do Qualite : 0.036914927986327575 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116901_31-01-2025_16_06_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116901 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116901 AND mptpi.`type`=4200 To do Qualite : 0.13120195092036752 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116902_31-01-2025_15_25_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116902 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116902 AND mptpi.`type`=3726 To do Qualite : 0.05778384063323714 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116903_31-01-2025_15_25_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116903 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116903 AND mptpi.`type`=4207 To do Qualite : 0.05778384063323714 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116903_31-01-2025_15_25_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116903 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116903 AND mptpi.`type`=4207 To do Qualite : 0.0030112047237664872 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116904_31-01-2025_17_10_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116904 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116904 AND mptpi.`type`=3327 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20117991 order by id desc limit 1 Qualite : 0.05516238847962785 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20117992_31-01-2025_17_04_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20117992 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20117992 AND mptpi.`type`=4207 To do Qualite : 0.05516238847962785 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20117992_31-01-2025_17_04_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20117992 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20117992 AND mptpi.`type`=4207 To do Qualite : 0.05728591369167183 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20117993_31-01-2025_17_02_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20117993 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20117993 AND mptpi.`type`=4200 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20117994 order by id desc limit 1 Qualite : 0.006116510660094263 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20118086_31-01-2025_18_20_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20118086 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20118086 AND mptpi.`type`=3327 To do Qualite : 0.05142021228171343 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20118087_31-01-2025_17_16_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20118087 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20118087 AND mptpi.`type`=4207 To do Qualite : 0.05142021228171343 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20118087_31-01-2025_17_16_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20118087 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20118087 AND mptpi.`type`=4207 To do Qualite : 0.0941318600501543 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20118088_31-01-2025_16_46_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20118088 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20118088 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20118089 order by id desc limit 1 Qualite : 0.054084543034637805 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121224_31-01-2025_22_19_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121224 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121224 AND mptpi.`type`=4211 To do Qualite : 0.05193382931776504 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20119790_31-01-2025_19_45_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119790 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119790 AND mptpi.`type`=4207 To do Qualite : 0.05193382931776504 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20119790_31-01-2025_19_45_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119790 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119790 AND mptpi.`type`=4207 To do Qualite : 0.027673635754115366 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20118800_31-01-2025_18_25_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20118800 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20118800 AND mptpi.`type`=4200 To do Qualite : 0.0028814866957487134 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20118801_31-01-2025_18_46_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20118801 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20118801 AND mptpi.`type`=3327 To do Qualite : 0.055418049072296714 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20118802_31-01-2025_18_33_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20118802 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20118802 AND mptpi.`type`=4211 To do Qualite : 0.0 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20118803_31-01-2025_18_23_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20118803 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20118803 AND mptpi.`type`=3327 To do Qualite : 0.048052208997863916 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20119792_31-01-2025_19_39_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119792 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119792 AND mptpi.`type`=4207 To do Qualite : 0.048052208997863916 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20119792_31-01-2025_19_39_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119792 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119792 AND mptpi.`type`=4207 To do Qualite : 0.04891874515452938 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20119794_31-01-2025_20_02_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119794 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119794 AND mptpi.`type`=4211 To do Qualite : 0.04141813711712598 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20119796_31-01-2025_19_53_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119796 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119796 AND mptpi.`type`=4200 To do Qualite : 0.050931190952783575 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20119798_31-01-2025_19_35_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119798 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119798 AND mptpi.`type`=4207 To do Qualite : 0.050931190952783575 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20119798_31-01-2025_19_35_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119798 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119798 AND mptpi.`type`=4207 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119801 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119803 order by id desc limit 1 Qualite : 0.00288225932534327 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20119805_31-01-2025_22_35_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119805 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119805 AND mptpi.`type`=3327 To do Qualite : 0.033157370448949786 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20119807_31-01-2025_19_57_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119807 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119807 AND mptpi.`type`=4200 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119809 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121227 order by id desc limit 1 Qualite : 0.04118007233146527 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121229_31-01-2025_22_08_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121229 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121229 AND mptpi.`type`=4207 To do Qualite : 0.04118007233146527 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121229_31-01-2025_22_08_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121229 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121229 AND mptpi.`type`=4207 To do Qualite : 0.05619545984030286 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121231_31-01-2025_22_23_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121231 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121231 AND mptpi.`type`=4211 To do Qualite : 0.001276028841739385 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121233_31-01-2025_23_27_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121233 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121233 AND mptpi.`type`=3327 To do Qualite : 0.05823438486612823 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121235_31-01-2025_22_06_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121235 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121235 AND mptpi.`type`=4207 To do Qualite : 0.05823438486612823 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121235_31-01-2025_22_06_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121235 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121235 AND mptpi.`type`=4207 To do Qualite : 0.08835539641203703 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121237_31-01-2025_21_14_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121237 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121237 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121239 order by id desc limit 1 Qualite : 0.07068776229246367 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121241_31-01-2025_22_29_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121241 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121241 AND mptpi.`type`=4200 To do Qualite : 0.06525091354991712 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121243_31-01-2025_21_59_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121243 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121243 AND mptpi.`type`=4207 To do Qualite : 0.06525091354991712 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121243_31-01-2025_21_59_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121243 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121243 AND mptpi.`type`=4207 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121245 order by id desc limit 1 Qualite : 0.023359382301220474 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20127076_01-02-2025_01_01_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127076 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127076 AND mptpi.`type`=3726 To do Qualite : 0.053315331448418254 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20127077_01-02-2025_00_46_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127077 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127077 AND mptpi.`type`=4207 To do Qualite : 0.053315331448418254 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20127077_01-02-2025_00_46_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127077 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127077 AND mptpi.`type`=4207 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'31012025': {'nb_upload': 23, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1333211566, 1333211559, 1333211553, 1333211539, 1333211511, 1333211507, 1333211502, 1333211499, 1333211467, 1333211400] Looping around the photos to save general results len do output : 1 /20101919Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211566', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211559', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211553', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211539', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211511', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211507', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211502', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211499', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211467', None, None, None, None, None, '2532921') ('4909', None, None, None, None, None, None, None, '2532921') ('4909', '20101919', '1333211400', None, None, None, None, None, '2532921') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.014475584030151367 save_final save missing photos in datou_result : time spend for datou_step_exec : 24.319540977478027 time spend to save output : 0.014691591262817383 total time spend for step 14 : 24.334232568740845 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 657.65user 195.43system 17:20.57elapsed 81%CPU (0avgtext+0avgdata 8972016maxresident)k 3468872inputs+842968outputs (80900major+37540441minor)pagefaults 0swaps