python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4909 -l 10 ' -s datou_current_4909 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3520381 load datou : 4909 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? id de la photo (peut être local ou global) was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5359, 'Mask_Limeil_Label_PEHD_080621', 16384, 25088, 'Mask_Limeil_Label_PEHD_080621', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 6, 9, 7, 22, 34), datetime.datetime(2021, 6, 9, 7, 22, 34)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5557, 'learn_generique_01122021_6000_v2', 2048, 2048, 'learn_generique_01122021_6000_v2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 1, 19, 59, 17), datetime.datetime(2021, 12, 1, 19, 59, 17)) load thcls load THCL from format json or kwargs add thcl : 2976 in CacheModelConfig load THCL from format json or kwargs add thcl : 3233 in CacheModelConfig load pdts add pdt : 5359 in CacheModelConfig add pdt : 5557 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 22>10 please execute split_portfolio.py -i 20108234 -l 10 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4909, datou_cur_ids : ['2533463'] with mtr_portfolio_ids : ['20108234'] and first list_photo_ids : [] new path : /proc/3520381/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, blur_detection, brightness, crop_condition, thcl, argmax, merge_mask_thcl_custom, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 3.149355173110962 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 14 step1:mask_detect Sat Feb 1 06:34:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3378 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-01 06:34:32.987696: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-01 06:34:33.015483: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493020000 Hz 2025-02-01 06:34:33.018249: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f4b20000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-01 06:34:33.018284: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-01 06:34:33.022411: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-01 06:34:33.283458: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1c19f5b0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-01 06:34:33.283525: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-01 06:34:33.284957: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 06:34:33.285421: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 06:34:33.288749: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 06:34:33.296839: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 06:34:33.297341: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 06:34:33.306184: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 06:34:33.308209: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 06:34:33.320700: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 06:34:33.322123: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 06:34:33.322223: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 06:34:33.322976: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 06:34:33.322997: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 06:34:33.323010: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 06:34:33.324246: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2926 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-01 06:34:33.617422: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 06:34:33.617532: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 06:34:33.617554: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 06:34:33.617574: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 06:34:33.617593: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 06:34:33.617612: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 06:34:33.617630: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 06:34:33.617649: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 06:34:33.618704: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 06:34:33.619756: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 06:34:33.619795: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 06:34:33.619818: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 06:34:33.619838: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 06:34:33.619858: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 06:34:33.619878: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 06:34:33.619898: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 06:34:33.619918: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 06:34:33.620960: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 06:34:33.620990: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 06:34:33.621000: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 06:34:33.621009: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 06:34:33.622105: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2926 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2976 thcls : [{'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5359 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5359, 'Mask_Limeil_Label_PEHD_080621', 16384, 25088, 'Mask_Limeil_Label_PEHD_080621', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 6, 9, 7, 22, 34), datetime.datetime(2021, 6, 9, 7, 22, 34)) {'thcl': {'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'environnement', 'fibreux_cont', 'metal_cont', 'pet_clair_cont', 'pet_fonce_cont', 'pet_opaque_cont', 'barquette', 'film_plastique', 'autre_contaminant', 'etiquette_detachee'], 'list_hashtags_csv': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'svm_hashtag_type_desc': 5359, 'photo_desc_type': 5359, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'environnement', 'fibreux_cont', 'metal_cont', 'pet_clair_cont', 'pet_fonce_cont', 'pet_opaque_cont', 'barquette', 'film_plastique', 'autre_contaminant', 'etiquette_detachee'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME Mask_Limeil_Label_PEHD_080621 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : Mask_Limeil_Label_PEHD_080621 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-01 06:34:45.513415: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 06:34:45.692491: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 06:34:47.071220: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.071871: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2279905536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.071898: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 06:34:47.072536: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.072553: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 06:34:47.079743: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.079770: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 06:34:47.080409: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.080425: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 06:34:47.086991: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.087023: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 06:34:47.087640: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.087658: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 06:34:47.118371: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.118406: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 06:34:47.119008: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.119024: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 06:34:47.124903: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.124925: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 06:34:47.125516: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.125531: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 06:34:47.159870: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.160537: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.162479: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.163120: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.207196: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.207868: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.210168: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.210760: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.241150: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.241748: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.243525: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.244168: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.249798: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.250386: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.252156: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.252798: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.258493: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.259084: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.260668: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.261255: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.287247: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.287853: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.288432: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.289007: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.292429: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.293010: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.308109: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.308698: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.309278: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.309856: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.321915: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.322520: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.323099: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.323722: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.327965: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.328551: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.333104: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.333692: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.345941: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.346530: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.350660: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.351247: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.351837: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.352421: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.353146: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.353734: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.364291: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.364903: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.365501: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.366079: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.366657: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.367235: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.382203: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.382793: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.434287: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.434889: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.435496: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.436108: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.443890: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.444533: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.461840: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.462654: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.463478: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.464267: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.468303: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.468891: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.469506: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.470089: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.471012: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.471027: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-02-01 06:34:47.481119: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.481759: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.490560: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.491139: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.491741: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.492320: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.492915: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:34:47.493490: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/Mask_Limeil_Label_PEHD_080621 /data/models_weight/Mask_Limeil_Label_PEHD_080621/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2021-08-11 19:43:15 create time in s3 : 2021-08-06 17:21:30 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.85000 image_metas shape: (1, 19) min: 0.00000 max: 3840.00000 nb d'objets trouves : 52 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.60000 image_metas shape: (1, 19) min: 0.00000 max: 3840.00000 nb d'objets trouves : 78 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.35000 image_metas shape: (1, 19) min: 0.00000 max: 3840.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.35000 image_metas shape: (1, 19) min: 0.00000 max: 3840.00000 nb d'objets trouves : 62 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.35000 image_metas shape: (1, 19) min: 0.00000 max: 3840.00000 nb d'objets trouves : 97 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.85000 image_metas shape: (1, 19) min: 0.00000 max: 3840.00000 nb d'objets trouves : 71 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.10000 image_metas shape: (1, 19) min: 0.00000 max: 3840.00000 nb d'objets trouves : 74 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 252.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.10000 image_metas shape: (1, 19) min: 0.00000 max: 3840.00000 nb d'objets trouves : 60 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.35000 image_metas shape: (1, 19) min: 0.00000 max: 3840.00000 nb d'objets trouves : 74 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.85000 image_metas shape: (1, 19) min: 0.00000 max: 3840.00000 nb d'objets trouves : 65 Detection mask done ! Trying to reset tf kernel 3520744 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1386 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2185 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2976 Catched exception ! Connect or reconnect ! thcls : [{'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5359 ['background', 'environnement', 'fibreux_cont', 'metal_cont', 'pet_clair_cont', 'pet_fonce_cont', 'pet_opaque_cont', 'barquette', 'film_plastique', 'autre_contaminant', 'etiquette_detachee'] time for calcul the mask position with numpy : 0.5303692817687988 nb_pixel_total : 424991 time to create 1 rle with new method : 0.026389122009277344 length of segment : 721 time for calcul the mask position with numpy : 0.15062499046325684 nb_pixel_total : 58180 time to create 1 rle with old method : 0.07306337356567383 length of segment : 324 time for calcul the mask position with numpy : 0.5938777923583984 nb_pixel_total : 439498 time to create 1 rle with new method : 0.029165983200073242 length of segment : 620 time for calcul the mask position with numpy : 0.4582674503326416 nb_pixel_total : 409310 time to create 1 rle with new method : 0.03872346878051758 length of segment : 819 time for calcul the mask position with numpy : 0.35492944717407227 nb_pixel_total : 281264 time to create 1 rle with new method : 0.024490833282470703 length of segment : 530 time for calcul the mask position with numpy : 0.23798465728759766 nb_pixel_total : 188297 time to create 1 rle with new method : 0.01664590835571289 length of segment : 647 time for calcul the mask position with numpy : 0.7720844745635986 nb_pixel_total : 380010 time to create 1 rle with new method : 0.03921627998352051 length of segment : 849 time for calcul the mask position with numpy : 0.3698546886444092 nb_pixel_total : 372737 time to create 1 rle with new method : 0.2977612018585205 length of segment : 1026 time for calcul the mask position with numpy : 0.18303942680358887 nb_pixel_total : 285559 time to create 1 rle with new method : 0.02120518684387207 length of segment : 629 time for calcul the mask position with numpy : 0.19392871856689453 nb_pixel_total : 297091 time to create 1 rle with new method : 0.03180074691772461 length of segment : 753 time for calcul the mask position with numpy : 0.0016407966613769531 nb_pixel_total : 50950 time to create 1 rle with old method : 0.059113264083862305 length of segment : 370 time for calcul the mask position with numpy : 0.007603168487548828 nb_pixel_total : 3140 time to create 1 rle with old method : 0.004017829895019531 length of segment : 50 time for calcul the mask position with numpy : 0.02852153778076172 nb_pixel_total : 45487 time to create 1 rle with old method : 0.0574491024017334 length of segment : 276 time for calcul the mask position with numpy : 0.20045828819274902 nb_pixel_total : 195616 time to create 1 rle with new method : 0.018746376037597656 length of segment : 1025 time for calcul the mask position with numpy : 0.0020334720611572266 nb_pixel_total : 21022 time to create 1 rle with old method : 0.025140047073364258 length of segment : 127 time for calcul the mask position with numpy : 0.08226609230041504 nb_pixel_total : 71899 time to create 1 rle with old method : 0.10243988037109375 length of segment : 466 time for calcul the mask position with numpy : 0.05351734161376953 nb_pixel_total : 254518 time to create 1 rle with new method : 0.0477757453918457 length of segment : 739 time for calcul the mask position with numpy : 0.03744196891784668 nb_pixel_total : 39265 time to create 1 rle with old method : 0.05540633201599121 length of segment : 250 time for calcul the mask position with numpy : 0.04093670845031738 nb_pixel_total : 94623 time to create 1 rle with old method : 0.12869024276733398 length of segment : 540 time for calcul the mask position with numpy : 0.02315688133239746 nb_pixel_total : 37011 time to create 1 rle with old method : 0.04656028747558594 length of segment : 221 time for calcul the mask position with numpy : 0.04735565185546875 nb_pixel_total : 38139 time to create 1 rle with old method : 0.05408906936645508 length of segment : 98 time for calcul the mask position with numpy : 0.016577482223510742 nb_pixel_total : 46595 time to create 1 rle with old method : 0.05685257911682129 length of segment : 354 time for calcul the mask position with numpy : 0.026505708694458008 nb_pixel_total : 90441 time to create 1 rle with old method : 0.1065218448638916 length of segment : 233 time for calcul the mask position with numpy : 0.32692503929138184 nb_pixel_total : 318687 time to create 1 rle with new method : 0.28063464164733887 length of segment : 683 time for calcul the mask position with numpy : 0.0002620220184326172 nb_pixel_total : 7199 time to create 1 rle with old method : 0.009454011917114258 length of segment : 102 time for calcul the mask position with numpy : 0.14900708198547363 nb_pixel_total : 393253 time to create 1 rle with new method : 0.12394261360168457 length of segment : 847 time for calcul the mask position with numpy : 0.004610776901245117 nb_pixel_total : 57788 time to create 1 rle with old method : 0.0679929256439209 length of segment : 289 time for calcul the mask position with numpy : 0.014646053314208984 nb_pixel_total : 42314 time to create 1 rle with old method : 0.053888559341430664 length of segment : 243 time for calcul the mask position with numpy : 0.02481985092163086 nb_pixel_total : 1006 time to create 1 rle with old method : 0.002424001693725586 length of segment : 43 time for calcul the mask position with numpy : 0.0006234645843505859 nb_pixel_total : 27243 time to create 1 rle with old method : 0.0372011661529541 length of segment : 150 time for calcul the mask position with numpy : 0.0070917606353759766 nb_pixel_total : 18682 time to create 1 rle with old method : 0.0284271240234375 length of segment : 219 time for calcul the mask position with numpy : 0.0006430149078369141 nb_pixel_total : 32854 time to create 1 rle with old method : 0.03896808624267578 length of segment : 215 time for calcul the mask position with numpy : 0.6189184188842773 nb_pixel_total : 403204 time to create 1 rle with new method : 0.021071910858154297 length of segment : 592 time for calcul the mask position with numpy : 0.8458342552185059 nb_pixel_total : 411987 time to create 1 rle with new method : 0.03845405578613281 length of segment : 756 time for calcul the mask position with numpy : 0.16826295852661133 nb_pixel_total : 49103 time to create 1 rle with old method : 0.059125423431396484 length of segment : 312 time for calcul the mask position with numpy : 0.08528327941894531 nb_pixel_total : 20262 time to create 1 rle with old method : 0.029816627502441406 length of segment : 221 time for calcul the mask position with numpy : 0.7071287631988525 nb_pixel_total : 340889 time to create 1 rle with new method : 0.05813264846801758 length of segment : 551 time for calcul the mask position with numpy : 0.2911496162414551 nb_pixel_total : 115525 time to create 1 rle with old method : 0.13297319412231445 length of segment : 322 time for calcul the mask position with numpy : 0.10691404342651367 nb_pixel_total : 36152 time to create 1 rle with old method : 0.049569129943847656 length of segment : 181 time for calcul the mask position with numpy : 0.9164557456970215 nb_pixel_total : 398296 time to create 1 rle with new method : 0.0347905158996582 length of segment : 795 time for calcul the mask position with numpy : 0.17259716987609863 nb_pixel_total : 42555 time to create 1 rle with old method : 0.06068086624145508 length of segment : 288 time for calcul the mask position with numpy : 0.7148838043212891 nb_pixel_total : 441234 time to create 1 rle with new method : 0.039728403091430664 length of segment : 1565 time for calcul the mask position with numpy : 0.15513992309570312 nb_pixel_total : 69596 time to create 1 rle with old method : 0.08358526229858398 length of segment : 334 time for calcul the mask position with numpy : 0.17490005493164062 nb_pixel_total : 47927 time to create 1 rle with old method : 0.05978250503540039 length of segment : 327 time for calcul the mask position with numpy : 0.11011242866516113 nb_pixel_total : 155272 time to create 1 rle with new method : 0.014394044876098633 length of segment : 682 time for calcul the mask position with numpy : 0.09344768524169922 nb_pixel_total : 70789 time to create 1 rle with old method : 0.09358906745910645 length of segment : 461 time for calcul the mask position with numpy : 0.24860215187072754 nb_pixel_total : 131054 time to create 1 rle with old method : 0.23430991172790527 length of segment : 390 time for calcul the mask position with numpy : 0.12626004219055176 nb_pixel_total : 59992 time to create 1 rle with old method : 0.07306480407714844 length of segment : 406 time for calcul the mask position with numpy : 0.04486393928527832 nb_pixel_total : 13355 time to create 1 rle with old method : 0.01781177520751953 length of segment : 109 time for calcul the mask position with numpy : 0.0382692813873291 nb_pixel_total : 30005 time to create 1 rle with old method : 0.04309368133544922 length of segment : 270 time for calcul the mask position with numpy : 0.05359625816345215 nb_pixel_total : 23865 time to create 1 rle with old method : 0.032596588134765625 length of segment : 214 time for calcul the mask position with numpy : 0.1031026840209961 nb_pixel_total : 27345 time to create 1 rle with old method : 0.03549456596374512 length of segment : 317 time for calcul the mask position with numpy : 0.13425183296203613 nb_pixel_total : 49679 time to create 1 rle with old method : 0.06004810333251953 length of segment : 255 time for calcul the mask position with numpy : 0.14005351066589355 nb_pixel_total : 86712 time to create 1 rle with old method : 0.10535240173339844 length of segment : 350 time for calcul the mask position with numpy : 0.05695343017578125 nb_pixel_total : 10332 time to create 1 rle with old method : 0.015840768814086914 length of segment : 111 time for calcul the mask position with numpy : 0.0007193088531494141 nb_pixel_total : 26721 time to create 1 rle with old method : 0.031061887741088867 length of segment : 267 time for calcul the mask position with numpy : 0.18064522743225098 nb_pixel_total : 19544 time to create 1 rle with old method : 0.02593207359313965 length of segment : 228 time for calcul the mask position with numpy : 0.35536837577819824 nb_pixel_total : 140031 time to create 1 rle with old method : 0.19151902198791504 length of segment : 460 time for calcul the mask position with numpy : 0.2426745891571045 nb_pixel_total : 95024 time to create 1 rle with old method : 0.15010881423950195 length of segment : 550 time for calcul the mask position with numpy : 0.003847360610961914 nb_pixel_total : 31468 time to create 1 rle with old method : 0.03843355178833008 length of segment : 279 time for calcul the mask position with numpy : 0.036235809326171875 nb_pixel_total : 30528 time to create 1 rle with old method : 0.04517841339111328 length of segment : 170 time for calcul the mask position with numpy : 0.10890746116638184 nb_pixel_total : 233476 time to create 1 rle with new method : 0.021548032760620117 length of segment : 921 time for calcul the mask position with numpy : 0.05283093452453613 nb_pixel_total : 88007 time to create 1 rle with old method : 0.14843440055847168 length of segment : 449 time for calcul the mask position with numpy : 0.0004284381866455078 nb_pixel_total : 10369 time to create 1 rle with old method : 0.014476537704467773 length of segment : 124 time for calcul the mask position with numpy : 0.005937814712524414 nb_pixel_total : 65437 time to create 1 rle with old method : 0.07392144203186035 length of segment : 390 time for calcul the mask position with numpy : 0.039061546325683594 nb_pixel_total : 51419 time to create 1 rle with old method : 0.06290650367736816 length of segment : 254 time for calcul the mask position with numpy : 0.021280527114868164 nb_pixel_total : 11736 time to create 1 rle with old method : 0.01664447784423828 length of segment : 96 time for calcul the mask position with numpy : 0.13188934326171875 nb_pixel_total : 78317 time to create 1 rle with old method : 0.09369587898254395 length of segment : 442 time for calcul the mask position with numpy : 0.42080116271972656 nb_pixel_total : 350034 time to create 1 rle with new method : 0.022757291793823242 length of segment : 655 time for calcul the mask position with numpy : 0.2544567584991455 nb_pixel_total : 80563 time to create 1 rle with old method : 0.10256242752075195 length of segment : 357 time for calcul the mask position with numpy : 0.4612240791320801 nb_pixel_total : 472771 time to create 1 rle with new method : 0.020835161209106445 length of segment : 621 time for calcul the mask position with numpy : 0.055590152740478516 nb_pixel_total : 21699 time to create 1 rle with old method : 0.03145551681518555 length of segment : 189 time for calcul the mask position with numpy : 0.3780386447906494 nb_pixel_total : 387085 time to create 1 rle with new method : 0.3206636905670166 length of segment : 791 time for calcul the mask position with numpy : 0.24247097969055176 nb_pixel_total : 332636 time to create 1 rle with new method : 0.08835530281066895 length of segment : 788 time for calcul the mask position with numpy : 0.3886525630950928 nb_pixel_total : 522518 time to create 1 rle with new method : 0.15654611587524414 length of segment : 1453 time for calcul the mask position with numpy : 0.34235358238220215 nb_pixel_total : 433512 time to create 1 rle with new method : 0.11366486549377441 length of segment : 669 time for calcul the mask position with numpy : 0.18657708168029785 nb_pixel_total : 201272 time to create 1 rle with new method : 0.021344661712646484 length of segment : 652 time for calcul the mask position with numpy : 0.23201441764831543 nb_pixel_total : 306017 time to create 1 rle with new method : 0.029366254806518555 length of segment : 938 time for calcul the mask position with numpy : 0.0372014045715332 nb_pixel_total : 22211 time to create 1 rle with old method : 0.031158924102783203 length of segment : 110 time for calcul the mask position with numpy : 0.1045534610748291 nb_pixel_total : 283114 time to create 1 rle with new method : 0.017444849014282227 length of segment : 622 time for calcul the mask position with numpy : 0.10393142700195312 nb_pixel_total : 296384 time to create 1 rle with new method : 0.03447151184082031 length of segment : 770 time for calcul the mask position with numpy : 0.04681229591369629 nb_pixel_total : 251457 time to create 1 rle with new method : 0.016628026962280273 length of segment : 625 time for calcul the mask position with numpy : 0.2891044616699219 nb_pixel_total : 481289 time to create 1 rle with new method : 0.07224488258361816 length of segment : 897 time for calcul the mask position with numpy : 0.12865424156188965 nb_pixel_total : 275702 time to create 1 rle with new method : 0.032105445861816406 length of segment : 608 time for calcul the mask position with numpy : 0.010414361953735352 nb_pixel_total : 22901 time to create 1 rle with old method : 0.03252458572387695 length of segment : 253 time for calcul the mask position with numpy : 0.00023126602172851562 nb_pixel_total : 8101 time to create 1 rle with old method : 0.010010480880737305 length of segment : 108 time for calcul the mask position with numpy : 0.018961668014526367 nb_pixel_total : 66541 time to create 1 rle with old method : 0.07907724380493164 length of segment : 209 time for calcul the mask position with numpy : 0.00010561943054199219 nb_pixel_total : 2361 time to create 1 rle with old method : 0.003120899200439453 length of segment : 53 time for calcul the mask position with numpy : 0.11461520195007324 nb_pixel_total : 357117 time to create 1 rle with new method : 0.041948795318603516 length of segment : 690 time for calcul the mask position with numpy : 0.0005767345428466797 nb_pixel_total : 25528 time to create 1 rle with old method : 0.029058218002319336 length of segment : 266 time for calcul the mask position with numpy : 0.0018041133880615234 nb_pixel_total : 32212 time to create 1 rle with old method : 0.03782486915588379 length of segment : 245 time for calcul the mask position with numpy : 0.005432844161987305 nb_pixel_total : 166117 time to create 1 rle with new method : 0.008569717407226562 length of segment : 403 time for calcul the mask position with numpy : 0.638066291809082 nb_pixel_total : 393669 time to create 1 rle with new method : 0.020529985427856445 length of segment : 607 time for calcul the mask position with numpy : 0.31264376640319824 nb_pixel_total : 113976 time to create 1 rle with old method : 0.13573145866394043 length of segment : 456 time for calcul the mask position with numpy : 0.56209397315979 nb_pixel_total : 440923 time to create 1 rle with new method : 0.0435023307800293 length of segment : 753 time for calcul the mask position with numpy : 0.7375953197479248 nb_pixel_total : 455295 time to create 1 rle with new method : 0.08812475204467773 length of segment : 815 time for calcul the mask position with numpy : 0.046068668365478516 nb_pixel_total : 35537 time to create 1 rle with old method : 0.057497501373291016 length of segment : 242 time for calcul the mask position with numpy : 0.48408961296081543 nb_pixel_total : 357614 time to create 1 rle with new method : 0.024925947189331055 length of segment : 858 time for calcul the mask position with numpy : 0.20539259910583496 nb_pixel_total : 80939 time to create 1 rle with old method : 0.09310126304626465 length of segment : 385 time for calcul the mask position with numpy : 0.266812801361084 nb_pixel_total : 124379 time to create 1 rle with old method : 0.14790821075439453 length of segment : 311 time for calcul the mask position with numpy : 0.02834939956665039 nb_pixel_total : 13403 time to create 1 rle with old method : 0.01941370964050293 length of segment : 123 time for calcul the mask position with numpy : 0.06667637825012207 nb_pixel_total : 19916 time to create 1 rle with old method : 0.030255556106567383 length of segment : 177 time for calcul the mask position with numpy : 0.5642876625061035 nb_pixel_total : 464861 time to create 1 rle with new method : 0.04083871841430664 length of segment : 1092 time for calcul the mask position with numpy : 0.060034990310668945 nb_pixel_total : 18403 time to create 1 rle with old method : 0.02750420570373535 length of segment : 175 time for calcul the mask position with numpy : 0.2315378189086914 nb_pixel_total : 97438 time to create 1 rle with old method : 0.11933398246765137 length of segment : 631 time for calcul the mask position with numpy : 0.053086042404174805 nb_pixel_total : 26880 time to create 1 rle with old method : 0.029022932052612305 length of segment : 142 time for calcul the mask position with numpy : 0.15341758728027344 nb_pixel_total : 147047 time to create 1 rle with old method : 0.17593121528625488 length of segment : 961 time for calcul the mask position with numpy : 0.05161619186401367 nb_pixel_total : 31695 time to create 1 rle with old method : 0.039674997329711914 length of segment : 211 time for calcul the mask position with numpy : 0.08004546165466309 nb_pixel_total : 44363 time to create 1 rle with old method : 0.05721879005432129 length of segment : 301 time for calcul the mask position with numpy : 0.08118915557861328 nb_pixel_total : 19122 time to create 1 rle with old method : 0.026993989944458008 length of segment : 209 time for calcul the mask position with numpy : 0.005150794982910156 nb_pixel_total : 35526 time to create 1 rle with old method : 0.04747152328491211 length of segment : 282 time for calcul the mask position with numpy : 0.0022978782653808594 nb_pixel_total : 25446 time to create 1 rle with old method : 0.030895709991455078 length of segment : 238 time for calcul the mask position with numpy : 0.03800058364868164 nb_pixel_total : 21939 time to create 1 rle with old method : 0.029032468795776367 length of segment : 189 time for calcul the mask position with numpy : 0.05870389938354492 nb_pixel_total : 35474 time to create 1 rle with old method : 0.04662942886352539 length of segment : 353 time for calcul the mask position with numpy : 0.05694913864135742 nb_pixel_total : 35381 time to create 1 rle with old method : 0.03932619094848633 length of segment : 261 time for calcul the mask position with numpy : 0.04876089096069336 nb_pixel_total : 40172 time to create 1 rle with old method : 0.0491480827331543 length of segment : 225 time for calcul the mask position with numpy : 0.011620759963989258 nb_pixel_total : 142248 time to create 1 rle with old method : 0.16469025611877441 length of segment : 602 time for calcul the mask position with numpy : 0.0014503002166748047 nb_pixel_total : 64629 time to create 1 rle with old method : 0.07746553421020508 length of segment : 579 time for calcul the mask position with numpy : 0.006133317947387695 nb_pixel_total : 28332 time to create 1 rle with old method : 0.03344869613647461 length of segment : 189 time for calcul the mask position with numpy : 0.1814110279083252 nb_pixel_total : 218972 time to create 1 rle with new method : 0.019870996475219727 length of segment : 568 time for calcul the mask position with numpy : 0.005294322967529297 nb_pixel_total : 75416 time to create 1 rle with old method : 0.08436775207519531 length of segment : 526 time for calcul the mask position with numpy : 0.20389771461486816 nb_pixel_total : 102837 time to create 1 rle with old method : 0.131880521774292 length of segment : 478 time for calcul the mask position with numpy : 0.09156370162963867 nb_pixel_total : 54257 time to create 1 rle with old method : 0.06389689445495605 length of segment : 433 time for calcul the mask position with numpy : 0.019170761108398438 nb_pixel_total : 15794 time to create 1 rle with old method : 0.021385908126831055 length of segment : 204 time for calcul the mask position with numpy : 0.5741176605224609 nb_pixel_total : 379061 time to create 1 rle with new method : 0.027469873428344727 length of segment : 597 time for calcul the mask position with numpy : 0.6817264556884766 nb_pixel_total : 434839 time to create 1 rle with new method : 0.03867053985595703 length of segment : 862 time for calcul the mask position with numpy : 0.9435038566589355 nb_pixel_total : 464431 time to create 1 rle with new method : 0.07576322555541992 length of segment : 789 time for calcul the mask position with numpy : 0.2995433807373047 nb_pixel_total : 67801 time to create 1 rle with old method : 0.07627439498901367 length of segment : 417 time for calcul the mask position with numpy : 0.2092752456665039 nb_pixel_total : 60309 time to create 1 rle with old method : 0.0749058723449707 length of segment : 315 time for calcul the mask position with numpy : 0.2107551097869873 nb_pixel_total : 74588 time to create 1 rle with old method : 0.0894622802734375 length of segment : 312 time for calcul the mask position with numpy : 0.08356523513793945 nb_pixel_total : 37378 time to create 1 rle with old method : 0.04598879814147949 length of segment : 244 time for calcul the mask position with numpy : 0.036551475524902344 nb_pixel_total : 15008 time to create 1 rle with old method : 0.022062301635742188 length of segment : 169 time for calcul the mask position with numpy : 0.06694364547729492 nb_pixel_total : 24508 time to create 1 rle with old method : 0.04382824897766113 length of segment : 179 time for calcul the mask position with numpy : 1.2850582599639893 nb_pixel_total : 261839 time to create 1 rle with new method : 0.041655778884887695 length of segment : 894 time for calcul the mask position with numpy : 0.5482556819915771 nb_pixel_total : 111538 time to create 1 rle with old method : 0.13390517234802246 length of segment : 345 time for calcul the mask position with numpy : 0.0668020248413086 nb_pixel_total : 27017 time to create 1 rle with old method : 0.034912109375 length of segment : 213 time for calcul the mask position with numpy : 0.08828163146972656 nb_pixel_total : 38865 time to create 1 rle with old method : 0.044782161712646484 length of segment : 198 time for calcul the mask position with numpy : 0.2810971736907959 nb_pixel_total : 237906 time to create 1 rle with new method : 0.022887229919433594 length of segment : 343 time for calcul the mask position with numpy : 0.42829203605651855 nb_pixel_total : 162578 time to create 1 rle with new method : 0.0173492431640625 length of segment : 683 time for calcul the mask position with numpy : 0.1502692699432373 nb_pixel_total : 31508 time to create 1 rle with old method : 0.04147934913635254 length of segment : 261 time for calcul the mask position with numpy : 0.050847530364990234 nb_pixel_total : 53936 time to create 1 rle with old method : 0.06756997108459473 length of segment : 279 time for calcul the mask position with numpy : 0.040543317794799805 nb_pixel_total : 13578 time to create 1 rle with old method : 0.019811391830444336 length of segment : 198 time for calcul the mask position with numpy : 0.0013275146484375 nb_pixel_total : 9626 time to create 1 rle with old method : 0.011519908905029297 length of segment : 112 time for calcul the mask position with numpy : 0.08223915100097656 nb_pixel_total : 38065 time to create 1 rle with old method : 0.047757863998413086 length of segment : 264 time for calcul the mask position with numpy : 0.07487130165100098 nb_pixel_total : 31954 time to create 1 rle with old method : 0.039777517318725586 length of segment : 234 time for calcul the mask position with numpy : 0.08732819557189941 nb_pixel_total : 69743 time to create 1 rle with old method : 0.08743762969970703 length of segment : 298 time for calcul the mask position with numpy : 0.33889245986938477 nb_pixel_total : 214728 time to create 1 rle with new method : 0.019273996353149414 length of segment : 1086 time for calcul the mask position with numpy : 0.3078470230102539 nb_pixel_total : 48928 time to create 1 rle with old method : 0.061577558517456055 length of segment : 336 time for calcul the mask position with numpy : 0.00916600227355957 nb_pixel_total : 23303 time to create 1 rle with old method : 0.03952646255493164 length of segment : 157 time for calcul the mask position with numpy : 0.6831932067871094 nb_pixel_total : 61304 time to create 1 rle with old method : 0.08610987663269043 length of segment : 442 time for calcul the mask position with numpy : 0.054056644439697266 nb_pixel_total : 55314 time to create 1 rle with old method : 0.0686194896697998 length of segment : 202 time for calcul the mask position with numpy : 0.39324140548706055 nb_pixel_total : 162830 time to create 1 rle with new method : 0.014965534210205078 length of segment : 804 time for calcul the mask position with numpy : 0.12911033630371094 nb_pixel_total : 46298 time to create 1 rle with old method : 0.05752372741699219 length of segment : 176 time for calcul the mask position with numpy : 0.16094183921813965 nb_pixel_total : 20474 time to create 1 rle with old method : 0.029767274856567383 length of segment : 277 time for calcul the mask position with numpy : 0.16928386688232422 nb_pixel_total : 56878 time to create 1 rle with old method : 0.06696343421936035 length of segment : 242 time for calcul the mask position with numpy : 0.003180265426635742 nb_pixel_total : 20453 time to create 1 rle with old method : 0.026547908782958984 length of segment : 189 time for calcul the mask position with numpy : 0.1610887050628662 nb_pixel_total : 105847 time to create 1 rle with old method : 0.12247419357299805 length of segment : 335 time for calcul the mask position with numpy : 0.04057955741882324 nb_pixel_total : 17902 time to create 1 rle with old method : 0.024693965911865234 length of segment : 198 time for calcul the mask position with numpy : 0.005303382873535156 nb_pixel_total : 5531 time to create 1 rle with old method : 0.006767749786376953 length of segment : 94 time for calcul the mask position with numpy : 0.017773866653442383 nb_pixel_total : 36768 time to create 1 rle with old method : 0.04450583457946777 length of segment : 213 time for calcul the mask position with numpy : 0.5204825401306152 nb_pixel_total : 106314 time to create 1 rle with old method : 0.12550020217895508 length of segment : 317 time for calcul the mask position with numpy : 0.0747838020324707 nb_pixel_total : 89848 time to create 1 rle with old method : 0.10659098625183105 length of segment : 272 time for calcul the mask position with numpy : 0.10434746742248535 nb_pixel_total : 43550 time to create 1 rle with old method : 0.05405926704406738 length of segment : 288 time for calcul the mask position with numpy : 1.2660953998565674 nb_pixel_total : 406266 time to create 1 rle with new method : 0.03258037567138672 length of segment : 860 time for calcul the mask position with numpy : 0.6844666004180908 nb_pixel_total : 373524 time to create 1 rle with new method : 0.026598215103149414 length of segment : 592 time for calcul the mask position with numpy : 0.9331042766571045 nb_pixel_total : 436758 time to create 1 rle with new method : 0.2574038505554199 length of segment : 763 time for calcul the mask position with numpy : 0.660759687423706 nb_pixel_total : 300498 time to create 1 rle with new method : 0.024690628051757812 length of segment : 975 time for calcul the mask position with numpy : 0.4128870964050293 nb_pixel_total : 207741 time to create 1 rle with new method : 0.014350175857543945 length of segment : 534 time for calcul the mask position with numpy : 0.05718731880187988 nb_pixel_total : 28877 time to create 1 rle with old method : 0.03708767890930176 length of segment : 186 time for calcul the mask position with numpy : 0.13090777397155762 nb_pixel_total : 45716 time to create 1 rle with old method : 0.05920815467834473 length of segment : 190 time for calcul the mask position with numpy : 0.5733273029327393 nb_pixel_total : 200523 time to create 1 rle with new method : 0.024374008178710938 length of segment : 698 time for calcul the mask position with numpy : 0.20990967750549316 nb_pixel_total : 53816 time to create 1 rle with old method : 0.06874966621398926 length of segment : 376 time for calcul the mask position with numpy : 0.47870802879333496 nb_pixel_total : 291057 time to create 1 rle with new method : 0.02529287338256836 length of segment : 1228 time for calcul the mask position with numpy : 0.003949880599975586 nb_pixel_total : 80914 time to create 1 rle with old method : 0.09412765502929688 length of segment : 576 time for calcul the mask position with numpy : 0.09293222427368164 nb_pixel_total : 34155 time to create 1 rle with old method : 0.04387688636779785 length of segment : 190 time for calcul the mask position with numpy : 0.20086669921875 nb_pixel_total : 107696 time to create 1 rle with old method : 0.12546706199645996 length of segment : 525 time for calcul the mask position with numpy : 0.011881113052368164 nb_pixel_total : 25647 time to create 1 rle with old method : 0.03515815734863281 length of segment : 177 time for calcul the mask position with numpy : 0.535048246383667 nb_pixel_total : 191166 time to create 1 rle with new method : 0.029905319213867188 length of segment : 537 time for calcul the mask position with numpy : 0.05842256546020508 nb_pixel_total : 15849 time to create 1 rle with old method : 0.032065391540527344 length of segment : 111 time for calcul the mask position with numpy : 0.022083044052124023 nb_pixel_total : 51430 time to create 1 rle with old method : 0.26776123046875 length of segment : 213 time for calcul the mask position with numpy : 0.09907197952270508 nb_pixel_total : 31282 time to create 1 rle with old method : 0.03915691375732422 length of segment : 232 time for calcul the mask position with numpy : 0.0664975643157959 nb_pixel_total : 71110 time to create 1 rle with old method : 0.08559703826904297 length of segment : 335 time for calcul the mask position with numpy : 0.017210960388183594 nb_pixel_total : 13619 time to create 1 rle with old method : 0.02034783363342285 length of segment : 176 time for calcul the mask position with numpy : 0.04975414276123047 nb_pixel_total : 30486 time to create 1 rle with old method : 0.03676605224609375 length of segment : 301 time for calcul the mask position with numpy : 0.6576535701751709 nb_pixel_total : 355716 time to create 1 rle with new method : 0.028537511825561523 length of segment : 612 time for calcul the mask position with numpy : 0.9157223701477051 nb_pixel_total : 454125 time to create 1 rle with new method : 0.031229257583618164 length of segment : 877 time for calcul the mask position with numpy : 0.22643637657165527 nb_pixel_total : 82897 time to create 1 rle with old method : 0.09963369369506836 length of segment : 310 time for calcul the mask position with numpy : 0.7558600902557373 nb_pixel_total : 419597 time to create 1 rle with new method : 0.028037071228027344 length of segment : 784 time for calcul the mask position with numpy : 0.5702776908874512 nb_pixel_total : 335031 time to create 1 rle with new method : 0.022216320037841797 length of segment : 908 time for calcul the mask position with numpy : 0.1021718978881836 nb_pixel_total : 39334 time to create 1 rle with old method : 0.05918741226196289 length of segment : 263 time for calcul the mask position with numpy : 0.06030893325805664 nb_pixel_total : 21315 time to create 1 rle with old method : 0.043381690979003906 length of segment : 123 time for calcul the mask position with numpy : 0.9206836223602295 nb_pixel_total : 176972 time to create 1 rle with new method : 0.021864891052246094 length of segment : 588 time for calcul the mask position with numpy : 0.19503569602966309 nb_pixel_total : 60546 time to create 1 rle with old method : 0.07302641868591309 length of segment : 327 time for calcul the mask position with numpy : 0.10309839248657227 nb_pixel_total : 43164 time to create 1 rle with old method : 0.06937241554260254 length of segment : 182 time for calcul the mask position with numpy : 0.08484268188476562 nb_pixel_total : 22608 time to create 1 rle with old method : 0.03158211708068848 length of segment : 213 time for calcul the mask position with numpy : 0.5559990406036377 nb_pixel_total : 408845 time to create 1 rle with new method : 0.04240059852600098 length of segment : 885 time for calcul the mask position with numpy : 0.1021733283996582 nb_pixel_total : 38811 time to create 1 rle with old method : 0.04807019233703613 length of segment : 190 time for calcul the mask position with numpy : 0.17861080169677734 nb_pixel_total : 75856 time to create 1 rle with old method : 0.0897054672241211 length of segment : 293 time for calcul the mask position with numpy : 0.03715872764587402 nb_pixel_total : 13023 time to create 1 rle with old method : 0.019268274307250977 length of segment : 96 time for calcul the mask position with numpy : 0.29779481887817383 nb_pixel_total : 165266 time to create 1 rle with new method : 0.012195348739624023 length of segment : 661 time for calcul the mask position with numpy : 0.03483319282531738 nb_pixel_total : 63018 time to create 1 rle with old method : 0.07401371002197266 length of segment : 475 time for calcul the mask position with numpy : 0.04906511306762695 nb_pixel_total : 57125 time to create 1 rle with old method : 0.0723578929901123 length of segment : 332 time for calcul the mask position with numpy : 0.0013422966003417969 nb_pixel_total : 55141 time to create 1 rle with old method : 0.06354331970214844 length of segment : 441 time for calcul the mask position with numpy : 0.019407272338867188 nb_pixel_total : 11514 time to create 1 rle with old method : 0.017937421798706055 length of segment : 107 time for calcul the mask position with numpy : 0.16076064109802246 nb_pixel_total : 69620 time to create 1 rle with old method : 0.08078646659851074 length of segment : 267 time for calcul the mask position with numpy : 0.13380908966064453 nb_pixel_total : 94628 time to create 1 rle with old method : 0.1056678295135498 length of segment : 340 time for calcul the mask position with numpy : 0.12842941284179688 nb_pixel_total : 56690 time to create 1 rle with old method : 0.06441926956176758 length of segment : 293 time for calcul the mask position with numpy : 0.0022585391998291016 nb_pixel_total : 28462 time to create 1 rle with old method : 0.03932046890258789 length of segment : 296 time for calcul the mask position with numpy : 0.0704343318939209 nb_pixel_total : 72376 time to create 1 rle with old method : 0.08076119422912598 length of segment : 297 time for calcul the mask position with numpy : 0.003751039505004883 nb_pixel_total : 16994 time to create 1 rle with old method : 0.02233600616455078 length of segment : 136 time for calcul the mask position with numpy : 0.0014994144439697266 nb_pixel_total : 41820 time to create 1 rle with old method : 0.046679019927978516 length of segment : 337 time for calcul the mask position with numpy : 0.019222259521484375 nb_pixel_total : 17166 time to create 1 rle with old method : 0.023131132125854492 length of segment : 154 time for calcul the mask position with numpy : 0.04875802993774414 nb_pixel_total : 149588 time to create 1 rle with old method : 0.17981624603271484 length of segment : 404 time for calcul the mask position with numpy : 0.07616949081420898 nb_pixel_total : 47267 time to create 1 rle with old method : 0.05657005310058594 length of segment : 375 time for calcul the mask position with numpy : 0.012920379638671875 nb_pixel_total : 24480 time to create 1 rle with old method : 0.0328984260559082 length of segment : 383 time for calcul the mask position with numpy : 0.25893521308898926 nb_pixel_total : 113129 time to create 1 rle with old method : 0.1331324577331543 length of segment : 375 time for calcul the mask position with numpy : 0.7636058330535889 nb_pixel_total : 388054 time to create 1 rle with new method : 0.03075861930847168 length of segment : 786 time for calcul the mask position with numpy : 0.7023699283599854 nb_pixel_total : 280894 time to create 1 rle with new method : 0.03006458282470703 length of segment : 796 time for calcul the mask position with numpy : 0.7152857780456543 nb_pixel_total : 435491 time to create 1 rle with new method : 0.028438568115234375 length of segment : 776 time for calcul the mask position with numpy : 0.19912314414978027 nb_pixel_total : 67747 time to create 1 rle with old method : 0.07980060577392578 length of segment : 291 time for calcul the mask position with numpy : 0.5158205032348633 nb_pixel_total : 387513 time to create 1 rle with new method : 0.019916534423828125 length of segment : 579 time for calcul the mask position with numpy : 0.6341660022735596 nb_pixel_total : 363299 time to create 1 rle with new method : 0.033078908920288086 length of segment : 715 time for calcul the mask position with numpy : 0.007885456085205078 nb_pixel_total : 32801 time to create 1 rle with old method : 0.04851388931274414 length of segment : 242 time for calcul the mask position with numpy : 0.2796976566314697 nb_pixel_total : 147910 time to create 1 rle with old method : 0.16739940643310547 length of segment : 565 time for calcul the mask position with numpy : 0.684138298034668 nb_pixel_total : 279088 time to create 1 rle with new method : 0.34450769424438477 length of segment : 664 time for calcul the mask position with numpy : 0.44790029525756836 nb_pixel_total : 326980 time to create 1 rle with new method : 0.027884960174560547 length of segment : 1096 time for calcul the mask position with numpy : 0.40514278411865234 nb_pixel_total : 438692 time to create 1 rle with new method : 0.06695842742919922 length of segment : 720 time for calcul the mask position with numpy : 0.6746444702148438 nb_pixel_total : 535130 time to create 1 rle with new method : 0.034699440002441406 length of segment : 1155 time for calcul the mask position with numpy : 0.030551910400390625 nb_pixel_total : 12405 time to create 1 rle with old method : 0.018354415893554688 length of segment : 146 time for calcul the mask position with numpy : 0.06807613372802734 nb_pixel_total : 346637 time to create 1 rle with new method : 0.030693769454956055 length of segment : 1426 time for calcul the mask position with numpy : 0.42963075637817383 nb_pixel_total : 272229 time to create 1 rle with new method : 0.2210369110107422 length of segment : 742 time for calcul the mask position with numpy : 0.11491584777832031 nb_pixel_total : 66211 time to create 1 rle with old method : 0.0846867561340332 length of segment : 259 time for calcul the mask position with numpy : 0.1324613094329834 nb_pixel_total : 163423 time to create 1 rle with new method : 0.00904536247253418 length of segment : 475 time for calcul the mask position with numpy : 0.0214998722076416 nb_pixel_total : 17014 time to create 1 rle with old method : 0.026616573333740234 length of segment : 108 time for calcul the mask position with numpy : 0.004022121429443359 nb_pixel_total : 35936 time to create 1 rle with old method : 0.044055938720703125 length of segment : 206 time for calcul the mask position with numpy : 0.08251547813415527 nb_pixel_total : 67664 time to create 1 rle with old method : 0.08625626564025879 length of segment : 396 time for calcul the mask position with numpy : 0.0061664581298828125 nb_pixel_total : 72746 time to create 1 rle with old method : 0.08344674110412598 length of segment : 408 time for calcul the mask position with numpy : 0.03118157386779785 nb_pixel_total : 50572 time to create 1 rle with old method : 0.072174072265625 length of segment : 285 time for calcul the mask position with numpy : 0.022838830947875977 nb_pixel_total : 58186 time to create 1 rle with old method : 0.0739293098449707 length of segment : 366 time for calcul the mask position with numpy : 0.005029439926147461 nb_pixel_total : 21024 time to create 1 rle with old method : 0.027606725692749023 length of segment : 166 time for calcul the mask position with numpy : 0.03381919860839844 nb_pixel_total : 128988 time to create 1 rle with old method : 0.1489861011505127 length of segment : 582 time for calcul the mask position with numpy : 0.0006349086761474609 nb_pixel_total : 21053 time to create 1 rle with old method : 0.025675535202026367 length of segment : 166 time for calcul the mask position with numpy : 0.024561166763305664 nb_pixel_total : 18723 time to create 1 rle with old method : 0.02630925178527832 length of segment : 187 time for calcul the mask position with numpy : 0.012361764907836914 nb_pixel_total : 32331 time to create 1 rle with old method : 0.04101109504699707 length of segment : 265 time for calcul the mask position with numpy : 0.0418393611907959 nb_pixel_total : 36193 time to create 1 rle with old method : 0.05669879913330078 length of segment : 184 time for calcul the mask position with numpy : 0.0858011245727539 nb_pixel_total : 138720 time to create 1 rle with old method : 0.15507197380065918 length of segment : 428 time for calcul the mask position with numpy : 0.04571676254272461 nb_pixel_total : 32488 time to create 1 rle with old method : 0.04187345504760742 length of segment : 123 time for calcul the mask position with numpy : 0.04280447959899902 nb_pixel_total : 40828 time to create 1 rle with old method : 0.05203890800476074 length of segment : 611 time for calcul the mask position with numpy : 0.009116888046264648 nb_pixel_total : 12241 time to create 1 rle with old method : 0.019898176193237305 length of segment : 144 time for calcul the mask position with numpy : 0.0067136287689208984 nb_pixel_total : 45288 time to create 1 rle with old method : 0.052869319915771484 length of segment : 249 time for calcul the mask position with numpy : 0.8169562816619873 nb_pixel_total : 397609 time to create 1 rle with new method : 0.02750873565673828 length of segment : 803 time for calcul the mask position with numpy : 0.38062310218811035 nb_pixel_total : 442329 time to create 1 rle with new method : 0.26812314987182617 length of segment : 607 time for calcul the mask position with numpy : 0.7523417472839355 nb_pixel_total : 488430 time to create 1 rle with new method : 0.029628515243530273 length of segment : 806 time for calcul the mask position with numpy : 0.060720205307006836 nb_pixel_total : 41809 time to create 1 rle with old method : 0.05115461349487305 length of segment : 335 time for calcul the mask position with numpy : 0.20775127410888672 nb_pixel_total : 83831 time to create 1 rle with old method : 0.10875916481018066 length of segment : 415 time for calcul the mask position with numpy : 0.657782793045044 nb_pixel_total : 286449 time to create 1 rle with new method : 0.028238534927368164 length of segment : 1115 time for calcul the mask position with numpy : 0.03424477577209473 nb_pixel_total : 56689 time to create 1 rle with old method : 0.06585264205932617 length of segment : 328 time for calcul the mask position with numpy : 0.05221676826477051 nb_pixel_total : 46205 time to create 1 rle with old method : 0.05619502067565918 length of segment : 238 time for calcul the mask position with numpy : 0.09474825859069824 nb_pixel_total : 75722 time to create 1 rle with old method : 0.09047245979309082 length of segment : 282 time for calcul the mask position with numpy : 0.03033280372619629 nb_pixel_total : 46641 time to create 1 rle with old method : 0.07027125358581543 length of segment : 244 time for calcul the mask position with numpy : 0.15933871269226074 nb_pixel_total : 160298 time to create 1 rle with new method : 0.011108636856079102 length of segment : 468 time for calcul the mask position with numpy : 0.0014805793762207031 nb_pixel_total : 29467 time to create 1 rle with old method : 0.036446571350097656 length of segment : 307 time for calcul the mask position with numpy : 0.0013566017150878906 nb_pixel_total : 33881 time to create 1 rle with old method : 0.041937828063964844 length of segment : 315 time for calcul the mask position with numpy : 0.09811973571777344 nb_pixel_total : 45884 time to create 1 rle with old method : 0.05712628364562988 length of segment : 187 time for calcul the mask position with numpy : 0.0059168338775634766 nb_pixel_total : 35789 time to create 1 rle with old method : 0.04316592216491699 length of segment : 288 time for calcul the mask position with numpy : 0.020357847213745117 nb_pixel_total : 9602 time to create 1 rle with old method : 0.016417503356933594 length of segment : 231 time for calcul the mask position with numpy : 0.2364058494567871 nb_pixel_total : 166028 time to create 1 rle with new method : 0.01126551628112793 length of segment : 506 time for calcul the mask position with numpy : 0.18784880638122559 nb_pixel_total : 126598 time to create 1 rle with old method : 0.15116524696350098 length of segment : 618 time for calcul the mask position with numpy : 0.03155803680419922 nb_pixel_total : 46873 time to create 1 rle with old method : 0.0773324966430664 length of segment : 333 time for calcul the mask position with numpy : 0.1995856761932373 nb_pixel_total : 203193 time to create 1 rle with new method : 0.019362449645996094 length of segment : 979 time for calcul the mask position with numpy : 0.03366684913635254 nb_pixel_total : 30848 time to create 1 rle with old method : 0.040880680084228516 length of segment : 169 time for calcul the mask position with numpy : 0.0264742374420166 nb_pixel_total : 31837 time to create 1 rle with old method : 0.04062676429748535 length of segment : 200 time for calcul the mask position with numpy : 0.0007460117340087891 nb_pixel_total : 38101 time to create 1 rle with old method : 0.04507303237915039 length of segment : 312 time for calcul the mask position with numpy : 0.00016021728515625 nb_pixel_total : 6947 time to create 1 rle with old method : 0.008184432983398438 length of segment : 118 time for calcul the mask position with numpy : 0.0214231014251709 nb_pixel_total : 45826 time to create 1 rle with old method : 0.057447195053100586 length of segment : 305 time for calcul the mask position with numpy : 0.06525468826293945 nb_pixel_total : 62996 time to create 1 rle with old method : 0.08059358596801758 length of segment : 380 time for calcul the mask position with numpy : 0.003844022750854492 nb_pixel_total : 27962 time to create 1 rle with old method : 0.03413534164428711 length of segment : 170 time for calcul the mask position with numpy : 0.034172773361206055 nb_pixel_total : 12711 time to create 1 rle with old method : 0.019063472747802734 length of segment : 235 time for calcul the mask position with numpy : 0.08990478515625 nb_pixel_total : 54529 time to create 1 rle with old method : 0.06754040718078613 length of segment : 254 time for calcul the mask position with numpy : 0.028645038604736328 nb_pixel_total : 13989 time to create 1 rle with old method : 0.022505521774291992 length of segment : 132 time for calcul the mask position with numpy : 0.008056163787841797 nb_pixel_total : 76337 time to create 1 rle with old method : 0.09368467330932617 length of segment : 282 time for calcul the mask position with numpy : 0.029680728912353516 nb_pixel_total : 27872 time to create 1 rle with old method : 0.03204703330993652 length of segment : 173 time for calcul the mask position with numpy : 0.08876395225524902 nb_pixel_total : 51810 time to create 1 rle with old method : 0.08054661750793457 length of segment : 255 time for calcul the mask position with numpy : 0.017658233642578125 nb_pixel_total : 48618 time to create 1 rle with old method : 0.058440208435058594 length of segment : 298 time for calcul the mask position with numpy : 0.09350323677062988 nb_pixel_total : 167737 time to create 1 rle with new method : 0.021556854248046875 length of segment : 631 time for calcul the mask position with numpy : 0.19521617889404297 nb_pixel_total : 429394 time to create 1 rle with new method : 0.02450871467590332 length of segment : 611 time for calcul the mask position with numpy : 0.22957396507263184 nb_pixel_total : 389638 time to create 1 rle with new method : 0.021634578704833984 length of segment : 794 time for calcul the mask position with numpy : 0.2393043041229248 nb_pixel_total : 411746 time to create 1 rle with new method : 0.03215765953063965 length of segment : 759 time for calcul the mask position with numpy : 0.03696012496948242 nb_pixel_total : 59253 time to create 1 rle with old method : 0.07077383995056152 length of segment : 277 time for calcul the mask position with numpy : 0.002394437789916992 nb_pixel_total : 7240 time to create 1 rle with old method : 0.008950948715209961 length of segment : 107 time for calcul the mask position with numpy : 0.025472640991210938 nb_pixel_total : 34883 time to create 1 rle with old method : 0.044483184814453125 length of segment : 215 time for calcul the mask position with numpy : 0.17712664604187012 nb_pixel_total : 79362 time to create 1 rle with old method : 0.10789728164672852 length of segment : 728 time for calcul the mask position with numpy : 0.13214921951293945 nb_pixel_total : 209869 time to create 1 rle with new method : 0.017060279846191406 length of segment : 704 time for calcul the mask position with numpy : 0.03432631492614746 nb_pixel_total : 91759 time to create 1 rle with old method : 0.10808825492858887 length of segment : 256 time for calcul the mask position with numpy : 0.015012025833129883 nb_pixel_total : 36139 time to create 1 rle with old method : 0.049653053283691406 length of segment : 371 time for calcul the mask position with numpy : 0.05893564224243164 nb_pixel_total : 100326 time to create 1 rle with old method : 0.1158604621887207 length of segment : 371 time for calcul the mask position with numpy : 0.01868462562561035 nb_pixel_total : 27794 time to create 1 rle with old method : 0.03651881217956543 length of segment : 324 time for calcul the mask position with numpy : 0.001088857650756836 nb_pixel_total : 51278 time to create 1 rle with old method : 0.05908083915710449 length of segment : 243 time for calcul the mask position with numpy : 0.027619600296020508 nb_pixel_total : 67914 time to create 1 rle with old method : 0.08593201637268066 length of segment : 289 time for calcul the mask position with numpy : 0.04862356185913086 nb_pixel_total : 223460 time to create 1 rle with new method : 0.02023005485534668 length of segment : 1085 time for calcul the mask position with numpy : 0.0372471809387207 nb_pixel_total : 74523 time to create 1 rle with old method : 0.08681774139404297 length of segment : 368 time for calcul the mask position with numpy : 0.016631364822387695 nb_pixel_total : 31427 time to create 1 rle with old method : 0.04031848907470703 length of segment : 411 time for calcul the mask position with numpy : 0.0299837589263916 nb_pixel_total : 73846 time to create 1 rle with old method : 0.09056377410888672 length of segment : 326 time for calcul the mask position with numpy : 0.003996849060058594 nb_pixel_total : 2596 time to create 1 rle with old method : 0.0038309097290039062 length of segment : 61 time for calcul the mask position with numpy : 0.04106712341308594 nb_pixel_total : 73827 time to create 1 rle with old method : 0.11997389793395996 length of segment : 283 time for calcul the mask position with numpy : 0.07390999794006348 nb_pixel_total : 87340 time to create 1 rle with old method : 0.10662007331848145 length of segment : 442 time for calcul the mask position with numpy : 0.028982877731323242 nb_pixel_total : 77834 time to create 1 rle with old method : 0.11294913291931152 length of segment : 455 time for calcul the mask position with numpy : 0.006773471832275391 nb_pixel_total : 85456 time to create 1 rle with old method : 0.1019906997680664 length of segment : 377 time for calcul the mask position with numpy : 0.06204485893249512 nb_pixel_total : 286751 time to create 1 rle with new method : 0.02977132797241211 length of segment : 380 time for calcul the mask position with numpy : 0.004069805145263672 nb_pixel_total : 82606 time to create 1 rle with old method : 0.09678959846496582 length of segment : 381 time for calcul the mask position with numpy : 0.023566484451293945 nb_pixel_total : 31907 time to create 1 rle with old method : 0.039073944091796875 length of segment : 289 time for calcul the mask position with numpy : 0.00037360191345214844 nb_pixel_total : 13493 time to create 1 rle with old method : 0.01694774627685547 length of segment : 135 time for calcul the mask position with numpy : 0.0016865730285644531 nb_pixel_total : 43825 time to create 1 rle with old method : 0.051668405532836914 length of segment : 382 time for calcul the mask position with numpy : 0.0008711814880371094 nb_pixel_total : 32726 time to create 1 rle with old method : 0.03860330581665039 length of segment : 274 time for calcul the mask position with numpy : 0.005033731460571289 nb_pixel_total : 38382 time to create 1 rle with old method : 0.04787588119506836 length of segment : 260 time for calcul the mask position with numpy : 0.0011684894561767578 nb_pixel_total : 1572 time to create 1 rle with old method : 0.0029664039611816406 length of segment : 36 time for calcul the mask position with numpy : 0.01426553726196289 nb_pixel_total : 18967 time to create 1 rle with old method : 0.031209468841552734 length of segment : 279 time for calcul the mask position with numpy : 0.010148048400878906 nb_pixel_total : 18962 time to create 1 rle with old method : 0.025733232498168945 length of segment : 193 time for calcul the mask position with numpy : 0.0008521080017089844 nb_pixel_total : 21222 time to create 1 rle with old method : 0.02421283721923828 length of segment : 264 time spent for convertir_results : 98.7481472492218 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 319 chid ids of type : 3760 Number RLEs to save : 133734 save missing photos in datou_result : time spend for datou_step_exec : 262.24558448791504 time spend to save output : 11.062705755233765 total time spend for step 1 : 273.3082902431488 step2:blur_detection Sat Feb 1 06:39:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1738388067_3520381_1333260105_785c81ed69bacf5bd3acf0740dd72f36.jpg resize: (2160, 3840) 1333260105 -3.4058318428375367 treat image : temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad.jpg resize: (2160, 3840) 1333260095 -5.2076593921828005 treat image : temp/1738388067_3520381_1333260011_238ed6bd94cccc95dc3bd0a1a8528817.jpg resize: (2160, 3840) 1333260011 -3.096438503662076 treat image : temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878.jpg resize: (2160, 3840) 1333260000 -5.335492899355421 treat image : temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d.jpg resize: (2160, 3840) 1333259996 -5.173635317456816 treat image : temp/1738388067_3520381_1333259830_35d5fc38622d425d505eee3d3bcbf1d0.jpg resize: (2160, 3840) 1333259830 -5.26182795430222 treat image : temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c.jpg resize: (2160, 3840) 1333259822 -5.244588441738222 treat image : temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1.jpg resize: (2160, 3840) 1333259741 -3.557791595298561 treat image : temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7.jpg resize: (2160, 3840) 1333259634 -5.006505313033296 treat image : temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4.jpg resize: (2160, 3840) 1333259603 -5.226842078450369 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 10 time used for this insertion : 0.014917373657226562 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 10 time used for this insertion : 0.12599492073059082 save missing photos in datou_result : time spend for datou_step_exec : 44.46695637702942 time spend to save output : 0.14622879028320312 total time spend for step 2 : 44.61318516731262 step3:brightness Sat Feb 1 06:39:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1738388067_3520381_1333260105_785c81ed69bacf5bd3acf0740dd72f36.jpg treat image : temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad.jpg treat image : temp/1738388067_3520381_1333260011_238ed6bd94cccc95dc3bd0a1a8528817.jpg treat image : temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878.jpg treat image : temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d.jpg treat image : temp/1738388067_3520381_1333259830_35d5fc38622d425d505eee3d3bcbf1d0.jpg treat image : temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c.jpg treat image : temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1.jpg treat image : temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7.jpg treat image : temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 10 time used for this insertion : 0.02129220962524414 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 10 time used for this insertion : 0.020023107528686523 save missing photos in datou_result : time spend for datou_step_exec : 11.0695219039917 time spend to save output : 0.04627633094787598 total time spend for step 3 : 11.115798234939575 step4:crop_condition Sat Feb 1 06:39:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3760 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 319 chid ids of type : 3760 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : barquette param for this class : {'min_score': 0.7} filtre for class : barquette hashtag_id of this class : 492787675 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 45 About to insert : list_path_to_insert length 45 new photo from crops ! About to upload 45 photos upload in portfolio : 4219792 init cache_photo without model_param we have 45 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738388418_3520381 we have uploaded 45 photos in the portfolio 4219792 time of upload the photos Elapsed time : 12.281729698181152 we have finished the crop for the class : barquette begin to crop the class : fibreux_cont param for this class : {'min_score': 0.7} filtre for class : fibreux_cont hashtag_id of this class : 2107756748 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 39 About to insert : list_path_to_insert length 39 new photo from crops ! About to upload 39 photos upload in portfolio : 4219792 init cache_photo without model_param we have 39 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738388441_3520381 we have uploaded 39 photos in the portfolio 4219792 time of upload the photos Elapsed time : 10.270583629608154 we have finished the crop for the class : fibreux_cont begin to crop the class : film_plastique param for this class : {'min_score': 0.7} filtre for class : film_plastique hashtag_id of this class : 2107756122 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 4219792 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738388459_3520381 we have uploaded 22 photos in the portfolio 4219792 time of upload the photos Elapsed time : 9.415497541427612 we have finished the crop for the class : film_plastique begin to crop the class : autre_contaminant param for this class : {'min_score': 0.7} filtre for class : autre_contaminant hashtag_id of this class : 2107756781 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 40 About to insert : list_path_to_insert length 40 new photo from crops ! About to upload 40 photos upload in portfolio : 4219792 init cache_photo without model_param we have 40 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738388481_3520381 we have uploaded 40 photos in the portfolio 4219792 time of upload the photos Elapsed time : 9.736437797546387 we have finished the crop for the class : autre_contaminant begin to crop the class : etiquette_detachee param for this class : {'min_score': 0.7} filtre for class : etiquette_detachee hashtag_id of this class : 2107756860 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 4219792 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738388494_3520381 we have uploaded 12 photos in the portfolio 4219792 time of upload the photos Elapsed time : 3.935112953186035 we have finished the crop for the class : etiquette_detachee begin to crop the class : pet_clair_cont param for this class : {'min_score': 0.7} filtre for class : pet_clair_cont hashtag_id of this class : 2107758154 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 25 About to insert : list_path_to_insert length 25 new photo from crops ! About to upload 25 photos upload in portfolio : 4219792 init cache_photo without model_param we have 25 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738388505_3520381 we have uploaded 25 photos in the portfolio 4219792 time of upload the photos Elapsed time : 6.317978382110596 we have finished the crop for the class : pet_clair_cont begin to crop the class : metal_cont param for this class : {'min_score': 0.7} filtre for class : metal_cont hashtag_id of this class : 2107756749 begin to crop the class : pet_fonce_cont param for this class : {'min_score': 0.7} filtre for class : pet_fonce_cont hashtag_id of this class : 2107758155 begin to crop the class : pet_opaque_cont param for this class : {'min_score': 0.7} filtre for class : pet_opaque_cont hashtag_id of this class : 2107758156 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 35 About to insert : list_path_to_insert length 35 new photo from crops ! About to upload 35 photos upload in portfolio : 4219792 init cache_photo without model_param we have 35 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738388523_3520381 we have uploaded 35 photos in the portfolio 4219792 time of upload the photos Elapsed time : 10.310603380203247 we have finished the crop for the class : pet_opaque_cont delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1333260105, 1333260095, 1333260011, 1333260000, 1333259996, 1333259830, 1333259822, 1333259741, 1333259634, 1333259603] Looping around the photos to save general results len do output : 218 /1333622064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333622427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260105', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260095', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260011', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260000', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259996', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259830', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259822', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259741', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259634', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259603', None, None, None, None, None, '2533463') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 664 time used for this insertion : 0.07955670356750488 save_final save missing photos in datou_result : time spend for datou_step_exec : 136.85665678977966 time spend to save output : 0.08451318740844727 total time spend for step 4 : 136.9411699771881 step5:thcl Sat Feb 1 06:42:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3233 time to import caffe and check if the image exist : 0.012628316879272461 time to convert the images to numpy array : 0.16854476928710938 time to import caffe and check if the image exist : 0.016040563583374023 time to convert the images to numpy array : 0.5919933319091797 time to import caffe and check if the image exist : 0.020168066024780273 time to convert the images to numpy array : 0.5928776264190674 time to import caffe and check if the image exist : 0.018017292022705078 time to convert the images to numpy array : 0.5932471752166748 time to import caffe and check if the image exist : 0.017218589782714844 time to convert the images to numpy array : 0.5967843532562256 time to import caffe and check if the image exist : 0.016255617141723633 time to convert the images to numpy array : 0.6191604137420654 time to import caffe and check if the image exist : 0.02170729637145996 time to convert the images to numpy array : 0.6208055019378662 time to import caffe and check if the image exist : 0.013108253479003906 time to convert the images to numpy array : 0.6332511901855469 time to import caffe and check if the image exist : 0.011299848556518555 time to convert the images to numpy array : 0.6728568077087402 time to import caffe and check if the image exist : 0.019253015518188477 time to convert the images to numpy array : 0.6717910766601562 total time to convert the images to numpy array : 1.0251507759094238 list photo_ids error: [] list photo_ids correct : [1333622309, 1333622310, 1333622311, 1333622312, 1333622332, 1333622335, 1333622338, 1333622341, 1333622343, 1333622344, 1333622345, 1333622347, 1333622348, 1333622349, 1333622350, 1333622351, 1333622353, 1333622354, 1333622355, 1333622356, 1333622357, 1333622358, 1333622226, 1333622227, 1333622228, 1333622229, 1333622230, 1333622231, 1333622232, 1333622233, 1333622234, 1333622235, 1333622236, 1333622237, 1333622238, 1333622239, 1333622240, 1333622241, 1333622242, 1333622243, 1333622256, 1333622257, 1333622258, 1333622259, 1333622283, 1333622284, 1333622285, 1333622286, 1333622287, 1333622288, 1333622289, 1333622290, 1333622291, 1333622292, 1333622293, 1333622294, 1333622295, 1333622296, 1333622300, 1333622302, 1333622303, 1333622304, 1333622305, 1333622306, 1333622307, 1333622308, 1333622149, 1333622150, 1333622151, 1333622152, 1333622153, 1333622154, 1333622155, 1333622156, 1333622157, 1333622159, 1333622160, 1333622161, 1333622162, 1333622163, 1333622164, 1333622165, 1333622167, 1333622169, 1333622222, 1333622223, 1333622224, 1333622225, 1333622408, 1333622409, 1333622410, 1333622411, 1333622412, 1333622413, 1333622414, 1333622415, 1333622416, 1333622417, 1333622418, 1333622419, 1333622420, 1333622421, 1333622422, 1333622423, 1333622424, 1333622425, 1333622426, 1333622427, 1333622108, 1333622127, 1333622128, 1333622129, 1333622130, 1333622131, 1333622132, 1333622133, 1333622134, 1333622135, 1333622136, 1333622138, 1333622139, 1333622140, 1333622141, 1333622142, 1333622143, 1333622144, 1333622145, 1333622146, 1333622147, 1333622148, 1333622260, 1333622261, 1333622262, 1333622263, 1333622264, 1333622266, 1333622267, 1333622268, 1333622269, 1333622270, 1333622271, 1333622272, 1333622273, 1333622274, 1333622275, 1333622276, 1333622277, 1333622278, 1333622279, 1333622280, 1333622281, 1333622282, 1333622359, 1333622360, 1333622362, 1333622363, 1333622364, 1333622365, 1333622367, 1333622393, 1333622394, 1333622395, 1333622396, 1333622397, 1333622398, 1333622399, 1333622400, 1333622401, 1333622402, 1333622403, 1333622404, 1333622405, 1333622406, 1333622407, 1333622064, 1333622065, 1333622066, 1333622067, 1333622068, 1333622069, 1333622070, 1333622071, 1333622072, 1333622073, 1333622074, 1333622075, 1333622076, 1333622077, 1333622078, 1333622079, 1333622080, 1333622081, 1333622082, 1333622083, 1333622084, 1333622085, 1333622086, 1333622087, 1333622088, 1333622089, 1333622090, 1333622091, 1333622092, 1333622093, 1333622094, 1333622095, 1333622096, 1333622097, 1333622098, 1333622099, 1333622100, 1333622101, 1333622102, 1333622103, 1333622104, 1333622105, 1333622106, 1333622107] number of photos to traite : 218 try to delete the photos incorrect in DB tagging for thcl : 3233 To do loadFromThcl(), then load ParamDescType : thcl3233 thcls : [{'id': 3233, 'mtr_user_id': 31, 'name': 'learn_generique_01122021_6000_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'barquette_opaque,carton,ela,environnement,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_fonce,pet_opaque,textiles_sanitaires', 'svm_portfolios_learning': '4825680,4829009,4825557,4824709,4824714,4824733,4825676,4824737,4824753,4829002,4824848,4824863,4825667,4825677', 'photo_hashtag_type': 4151, 'photo_desc_type': 5557, 'type_classification': 'caffe', 'hashtag_id_list': '2107760128,492774966,492741797,493012381,492636447,2107756122,493202403,492628673,492668766,628944319,2107755846,2107755900,2107759152,2107760129'}] thcl {'id': 3233, 'mtr_user_id': 31, 'name': 'learn_generique_01122021_6000_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'barquette_opaque,carton,ela,environnement,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_fonce,pet_opaque,textiles_sanitaires', 'svm_portfolios_learning': '4825680,4829009,4825557,4824709,4824714,4824733,4825676,4824737,4824753,4829002,4824848,4824863,4825667,4825677', 'photo_hashtag_type': 4151, 'photo_desc_type': 5557, 'type_classification': 'caffe', 'hashtag_id_list': '2107760128,492774966,492741797,493012381,492636447,2107756122,493202403,492628673,492668766,628944319,2107755846,2107755900,2107759152,2107760129'} Update svm_hashtag_type_desc : 5557 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5557, 'learn_generique_01122021_6000_v2', 2048, 2048, 'learn_generique_01122021_6000_v2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 1, 19, 59, 17), datetime.datetime(2021, 12, 1, 19, 59, 17)) To loadFromThcl() : net_5557 begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 2500 l 3632 free memory gpu now : 1966 wait 20 seconds l 3637 free memory gpu now : 1966 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5557, 'learn_generique_01122021_6000_v2', 2048, 2048, 'learn_generique_01122021_6000_v2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 1, 19, 59, 17), datetime.datetime(2021, 12, 1, 19, 59, 17)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_generique_01122021_6000_v2 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_generique_01122021_6000_v2 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_generique_01122021_6000_v2 /data/models_weight/learn_generique_01122021_6000_v2/caffemodel size_local : 94383085 size in s3 : 94383085 create time local : 2021-12-09 17:03:46 create time in s3 : 2021-12-01 18:45:54 caffemodel already exist and didn't need to update /data/models_weight/learn_generique_01122021_6000_v2/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-09 17:03:46 create time in s3 : 2021-12-01 18:45:53 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_generique_01122021_6000_v2/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-09 17:03:47 create time in s3 : 2021-12-01 18:59:02 mean.npy already exist and didn't need to update /data/models_weight/learn_generique_01122021_6000_v2/synset_words.txt size_local : 454 size in s3 : 454 create time local : 2021-12-09 17:03:47 create time in s3 : 2021-12-01 18:59:15 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_generique_01122021_6000_v2/deploy.prototxt caffemodel_filename : /data/models_weight/learn_generique_01122021_6000_v2/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 2500 l 3632 free memory gpu now : 2042 wait 20 seconds l 3637 free memory gpu now : 2042 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.778062343597412 time used to do the prediction : 1.1566193103790283 save descriptor for thcl : 3233 time to traite the descriptors : 1.2510428428649902 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1333622309 To insert : 1333622310 To insert : 1333622311 To insert : 1333622312 To insert : 1333622332 To insert : 1333622335 To insert : 1333622338 To insert : 1333622341 To insert : 1333622343 To insert : 1333622344 To insert : 1333622345 To insert : 1333622347 To insert : 1333622348 To insert : 1333622349 To insert : 1333622350 To insert : 1333622351 To insert : 1333622353 To insert : 1333622354 To insert : 1333622355 To insert : 1333622356 To insert : 1333622357 To insert : 1333622358 To insert : 1333622226 To insert : 1333622227 To insert : 1333622228 To insert : 1333622229 To insert : 1333622230 To insert : 1333622231 To insert : 1333622232 To insert : 1333622233 To insert : 1333622234 To insert : 1333622235 To insert : 1333622236 To insert : 1333622237 To insert : 1333622238 To insert : 1333622239 To insert : 1333622240 To insert : 1333622241 To insert : 1333622242 To insert : 1333622243 To insert : 1333622256 To insert : 1333622257 To insert : 1333622258 To insert : 1333622259 To insert : 1333622283 To insert : 1333622284 To insert : 1333622285 To insert : 1333622286 To insert : 1333622287 To insert : 1333622288 To insert : 1333622289 To insert : 1333622290 To insert : 1333622291 To insert : 1333622292 To insert : 1333622293 To insert : 1333622294 To insert : 1333622295 To insert : 1333622296 To insert : 1333622300 To insert : 1333622302 To insert : 1333622303 To insert : 1333622304 To insert : 1333622305 To insert : 1333622306 To insert : 1333622307 To insert : 1333622308 To insert : 1333622149 To insert : 1333622150 To insert : 1333622151 To insert : 1333622152 To insert : 1333622153 To insert : 1333622154 To insert : 1333622155 To insert : 1333622156 To insert : 1333622157 To insert : 1333622159 To insert : 1333622160 To insert : 1333622161 To insert : 1333622162 To insert : 1333622163 To insert : 1333622164 To insert : 1333622165 To insert : 1333622167 To insert : 1333622169 To insert : 1333622222 To insert : 1333622223 To insert : 1333622224 To insert : 1333622225 To insert : 1333622408 To insert : 1333622409 To insert : 1333622410 To insert : 1333622411 To insert : 1333622412 To insert : 1333622413 To insert : 1333622414 To insert : 1333622415 To insert : 1333622416 To insert : 1333622417 To insert : 1333622418 To insert : 1333622419 To insert : 1333622420 To insert : 1333622421 To insert : 1333622422 To insert : 1333622423 To insert : 1333622424 To insert : 1333622425 To insert : 1333622426 To insert : 1333622427 To insert : 1333622108 To insert : 1333622127 To insert : 1333622128 To insert : 1333622129 To insert : 1333622130 To insert : 1333622131 To insert : 1333622132 To insert : 1333622133 To insert : 1333622134 To insert : 1333622135 To insert : 1333622136 To insert : 1333622138 To insert : 1333622139 To insert : 1333622140 To insert : 1333622141 To insert : 1333622142 To insert : 1333622143 To insert : 1333622144 To insert : 1333622145 To insert : 1333622146 To insert : 1333622147 To insert : 1333622148 To insert : 1333622260 To insert : 1333622261 To insert : 1333622262 To insert : 1333622263 To insert : 1333622264 To insert : 1333622266 To insert : 1333622267 To insert : 1333622268 To insert : 1333622269 To insert : 1333622270 To insert : 1333622271 To insert : 1333622272 To insert : 1333622273 To insert : 1333622274 To insert : 1333622275 To insert : 1333622276 To insert : 1333622277 To insert : 1333622278 To insert : 1333622279 To insert : 1333622280 To insert : 1333622281 To insert : 1333622282 To insert : 1333622359 To insert : 1333622360 To insert : 1333622362 To insert : 1333622363 To insert : 1333622364 To insert : 1333622365 To insert : 1333622367 To insert : 1333622393 To insert : 1333622394 To insert : 1333622395 To insert : 1333622396 To insert : 1333622397 To insert : 1333622398 To insert : 1333622399 To insert : 1333622400 To insert : 1333622401 To insert : 1333622402 To insert : 1333622403 To insert : 1333622404 To insert : 1333622405 To insert : 1333622406 To insert : 1333622407 To insert : 1333622064 To insert : 1333622065 To insert : 1333622066 To insert : 1333622067 To insert : 1333622068 To insert : 1333622069 To insert : 1333622070 To insert : 1333622071 To insert : 1333622072 To insert : 1333622073 To insert : 1333622074 To insert : 1333622075 To insert : 1333622076 To insert : 1333622077 To insert : 1333622078 To insert : 1333622079 To insert : 1333622080 To insert : 1333622081 To insert : 1333622082 To insert : 1333622083 To insert : 1333622084 To insert : 1333622085 To insert : 1333622086 To insert : 1333622087 To insert : 1333622088 To insert : 1333622089 To insert : 1333622090 To insert : 1333622091 To insert : 1333622092 To insert : 1333622093 To insert : 1333622094 To insert : 1333622095 To insert : 1333622096 To insert : 1333622097 To insert : 1333622098 To insert : 1333622099 To insert : 1333622100 To insert : 1333622101 To insert : 1333622102 To insert : 1333622103 To insert : 1333622104 To insert : 1333622105 To insert : 1333622106 To insert : 1333622107 time to insert the descriptors : 37.12748432159424 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 320 time used for this insertion : 0.03198075294494629 save missing photos in datou_result : time spend for datou_step_exec : 86.50254845619202 time spend to save output : 0.09857535362243652 total time spend for step 5 : 86.60112380981445 step6:argmax Sat Feb 1 06:43:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou_step Argmax ! calculate argmax for thcl : 3233 Inside saveOutput : final : False verbose : 0 photo_id : 1333622309 output[photo_id] : [('1333622309', 'pehd', 0.4731666, 4151, '3233'), 'temp/1738388067_3520381_1333259830_35d5fc38622d425d505eee3d3bcbf1d0_rle_crop_3648431109_0.png'] photo_id : 1333622310 output[photo_id] : [('1333622310', 'carton', 0.66359544, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431148_0.png'] photo_id : 1333622311 output[photo_id] : [('1333622311', 'papier', 0.99142456, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431205_0.png'] photo_id : 1333622312 output[photo_id] : [('1333622312', 'papier', 0.95942944, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431257_0.png'] photo_id : 1333622332 output[photo_id] : [('1333622332', 'papier', 0.8740665, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648430996_0.png'] photo_id : 1333622335 output[photo_id] : [('1333622335', 'film_plastique', 0.35929424, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648430994_0.png'] photo_id : 1333622338 output[photo_id] : [('1333622338', 'carton', 0.6546108, 4151, '3233'), 'temp/1738388067_3520381_1333260011_238ed6bd94cccc95dc3bd0a1a8528817_rle_crop_3648431030_0.png'] photo_id : 1333622341 output[photo_id] : [('1333622341', 'papier', 0.5096352, 4151, '3233'), 'temp/1738388067_3520381_1333260011_238ed6bd94cccc95dc3bd0a1a8528817_rle_crop_3648431024_0.png'] photo_id : 1333622343 output[photo_id] : [('1333622343', 'papier', 0.36668122, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431043_0.png'] photo_id : 1333622344 output[photo_id] : [('1333622344', 'papier', 0.92289734, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431055_0.png'] photo_id : 1333622345 output[photo_id] : [('1333622345', 'pehd', 0.4696972, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431063_0.png'] photo_id : 1333622347 output[photo_id] : [('1333622347', 'carton', 0.41557333, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431099_0.png'] photo_id : 1333622348 output[photo_id] : [('1333622348', 'papier', 0.6416736, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431092_0.png'] photo_id : 1333622349 output[photo_id] : [('1333622349', 'carton', 0.21723193, 4151, '3233'), 'temp/1738388067_3520381_1333259830_35d5fc38622d425d505eee3d3bcbf1d0_rle_crop_3648431120_0.png'] photo_id : 1333622350 output[photo_id] : [('1333622350', 'papier', 0.8239689, 4151, '3233'), 'temp/1738388067_3520381_1333259830_35d5fc38622d425d505eee3d3bcbf1d0_rle_crop_3648431118_0.png'] photo_id : 1333622351 output[photo_id] : [('1333622351', 'pehd', 0.90102464, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431146_0.png'] photo_id : 1333622353 output[photo_id] : [('1333622353', 'ela', 0.668811, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431171_0.png'] photo_id : 1333622354 output[photo_id] : [('1333622354', 'pehd', 0.4282577, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431189_0.png'] photo_id : 1333622355 output[photo_id] : [('1333622355', 'carton', 0.7399676, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431186_0.png'] photo_id : 1333622356 output[photo_id] : [('1333622356', 'barquette_opaque', 0.6509706, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431168_0.png'] photo_id : 1333622357 output[photo_id] : [('1333622357', 'pehd', 0.47530186, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431184_0.png'] photo_id : 1333622358 output[photo_id] : [('1333622358', 'papier', 0.5309254, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431173_0.png'] photo_id : 1333622226 output[photo_id] : [('1333622226', 'papier', 0.7565308, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431041_0.png'] photo_id : 1333622227 output[photo_id] : [('1333622227', 'film_plastique', 0.8222593, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431054_0.png'] photo_id : 1333622228 output[photo_id] : [('1333622228', 'papier', 0.8825672, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431062_0.png'] photo_id : 1333622229 output[photo_id] : [('1333622229', 'papier', 0.7371022, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431049_0.png'] photo_id : 1333622230 output[photo_id] : [('1333622230', 'film_plastique', 0.3633178, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431058_0.png'] photo_id : 1333622231 output[photo_id] : [('1333622231', 'papier', 0.37224814, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431093_0.png'] photo_id : 1333622232 output[photo_id] : [('1333622232', 'carton', 0.76299566, 4151, '3233'), 'temp/1738388067_3520381_1333259830_35d5fc38622d425d505eee3d3bcbf1d0_rle_crop_3648431123_0.png'] photo_id : 1333622233 output[photo_id] : [('1333622233', 'carton', 0.72631204, 4151, '3233'), 'temp/1738388067_3520381_1333259830_35d5fc38622d425d505eee3d3bcbf1d0_rle_crop_3648431111_0.png'] photo_id : 1333622234 output[photo_id] : [('1333622234', 'papier', 0.37060252, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431138_0.png'] photo_id : 1333622235 output[photo_id] : [('1333622235', 'film_plastique', 0.5166036, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431159_0.png'] photo_id : 1333622236 output[photo_id] : [('1333622236', 'pehd', 0.49804258, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431176_0.png'] photo_id : 1333622237 output[photo_id] : [('1333622237', 'barquette_opaque', 0.33474714, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431181_0.png'] photo_id : 1333622238 output[photo_id] : [('1333622238', 'carton', 0.59429514, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431187_0.png'] photo_id : 1333622239 output[photo_id] : [('1333622239', 'pehd', 0.85879374, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431214_0.png'] photo_id : 1333622240 output[photo_id] : [('1333622240', 'pehd', 0.69378096, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431208_0.png'] photo_id : 1333622241 output[photo_id] : [('1333622241', 'carton', 0.50691503, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431193_0.png'] photo_id : 1333622242 output[photo_id] : [('1333622242', 'pehd', 0.89433706, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431258_0.png'] photo_id : 1333622243 output[photo_id] : [('1333622243', 'metal', 0.4381478, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431250_0.png'] photo_id : 1333622256 output[photo_id] : [('1333622256', 'pet_opaque', 0.45870107, 4151, '3233'), 'temp/1738388067_3520381_1333260105_785c81ed69bacf5bd3acf0740dd72f36_rle_crop_3648430941_0.png'] photo_id : 1333622257 output[photo_id] : [('1333622257', 'pet_opaque', 0.45657572, 4151, '3233'), 'temp/1738388067_3520381_1333260105_785c81ed69bacf5bd3acf0740dd72f36_rle_crop_3648430959_0.png'] photo_id : 1333622258 output[photo_id] : [('1333622258', 'environnement', 0.77076954, 4151, '3233'), 'temp/1738388067_3520381_1333260105_785c81ed69bacf5bd3acf0740dd72f36_rle_crop_3648430954_0.png'] photo_id : 1333622259 output[photo_id] : [('1333622259', 'papier', 0.7100817, 4151, '3233'), 'temp/1738388067_3520381_1333260105_785c81ed69bacf5bd3acf0740dd72f36_rle_crop_3648430969_0.png'] photo_id : 1333622283 output[photo_id] : [('1333622283', 'pet_fonce', 0.33312738, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431131_0.png'] photo_id : 1333622284 output[photo_id] : [('1333622284', 'papier', 0.70459276, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431143_0.png'] photo_id : 1333622285 output[photo_id] : [('1333622285', 'carton', 0.8436576, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431141_0.png'] photo_id : 1333622286 output[photo_id] : [('1333622286', 'papier', 0.473798, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431188_0.png'] photo_id : 1333622287 output[photo_id] : [('1333622287', 'carton', 0.59351647, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431185_0.png'] photo_id : 1333622288 output[photo_id] : [('1333622288', 'papier', 0.9284782, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431174_0.png'] photo_id : 1333622289 output[photo_id] : [('1333622289', 'pehd', 0.56728184, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431220_0.png'] photo_id : 1333622290 output[photo_id] : [('1333622290', 'pehd', 0.9756074, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431201_0.png'] photo_id : 1333622291 output[photo_id] : [('1333622291', 'carton', 0.8169918, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431219_0.png'] photo_id : 1333622292 output[photo_id] : [('1333622292', 'pehd', 0.96911263, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431197_0.png'] photo_id : 1333622293 output[photo_id] : [('1333622293', 'papier', 0.36875942, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431223_0.png'] photo_id : 1333622294 output[photo_id] : [('1333622294', 'pehd', 0.31388205, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431247_0.png'] photo_id : 1333622295 output[photo_id] : [('1333622295', 'metal', 0.94788843, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431255_0.png'] photo_id : 1333622296 output[photo_id] : [('1333622296', 'papier', 0.37522906, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431241_0.png'] photo_id : 1333622300 output[photo_id] : [('1333622300', 'pehd', 0.6409038, 4151, '3233'), 'temp/1738388067_3520381_1333260105_785c81ed69bacf5bd3acf0740dd72f36_rle_crop_3648430957_0.png'] photo_id : 1333622302 output[photo_id] : [('1333622302', 'etiquette', 0.7538544, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648431003_0.png'] photo_id : 1333622303 output[photo_id] : [('1333622303', 'pehd', 0.5054388, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648430995_0.png'] photo_id : 1333622304 output[photo_id] : [('1333622304', 'papier', 0.3291704, 4151, '3233'), 'temp/1738388067_3520381_1333260011_238ed6bd94cccc95dc3bd0a1a8528817_rle_crop_3648431029_0.png'] photo_id : 1333622305 output[photo_id] : [('1333622305', 'papier', 0.6389699, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431048_0.png'] photo_id : 1333622306 output[photo_id] : [('1333622306', 'pehd', 0.5843676, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431045_0.png'] photo_id : 1333622307 output[photo_id] : [('1333622307', 'ela', 0.88779235, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431072_0.png'] photo_id : 1333622308 output[photo_id] : [('1333622308', 'papier', 0.98504204, 4151, '3233'), 'temp/1738388067_3520381_1333259830_35d5fc38622d425d505eee3d3bcbf1d0_rle_crop_3648431116_0.png'] photo_id : 1333622149 output[photo_id] : [('1333622149', 'metal', 0.3961313, 4151, '3233'), 'temp/1738388067_3520381_1333259830_35d5fc38622d425d505eee3d3bcbf1d0_rle_crop_3648431115_0.png'] photo_id : 1333622150 output[photo_id] : [('1333622150', 'papier', 0.8315296, 4151, '3233'), 'temp/1738388067_3520381_1333259830_35d5fc38622d425d505eee3d3bcbf1d0_rle_crop_3648431122_0.png'] photo_id : 1333622151 output[photo_id] : [('1333622151', 'papier', 0.42015836, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431151_0.png'] photo_id : 1333622152 output[photo_id] : [('1333622152', 'pehd', 0.3741159, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431132_0.png'] photo_id : 1333622153 output[photo_id] : [('1333622153', 'ela', 0.9563934, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431162_0.png'] photo_id : 1333622154 output[photo_id] : [('1333622154', 'pehd', 0.4780356, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431179_0.png'] photo_id : 1333622155 output[photo_id] : [('1333622155', 'papier', 0.8942853, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431213_0.png'] photo_id : 1333622156 output[photo_id] : [('1333622156', 'papier', 0.5999166, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431204_0.png'] photo_id : 1333622157 output[photo_id] : [('1333622157', 'pehd', 0.60168797, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431212_0.png'] photo_id : 1333622159 output[photo_id] : [('1333622159', 'papier', 0.93989456, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431194_0.png'] photo_id : 1333622160 output[photo_id] : [('1333622160', 'papier', 0.7669669, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431196_0.png'] photo_id : 1333622161 output[photo_id] : [('1333622161', 'pehd', 0.44364616, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431199_0.png'] photo_id : 1333622162 output[photo_id] : [('1333622162', 'papier', 0.61745244, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431216_0.png'] photo_id : 1333622163 output[photo_id] : [('1333622163', 'barquette_opaque', 0.29093498, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431202_0.png'] photo_id : 1333622164 output[photo_id] : [('1333622164', 'ela', 0.75346917, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431234_0.png'] photo_id : 1333622165 output[photo_id] : [('1333622165', 'etiquette', 0.40341923, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431251_0.png'] photo_id : 1333622167 output[photo_id] : [('1333622167', 'papier', 0.6924173, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431256_0.png'] photo_id : 1333622169 output[photo_id] : [('1333622169', 'papier', 0.54028636, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431229_0.png'] photo_id : 1333622222 output[photo_id] : [('1333622222', 'pehd', 0.8911849, 4151, '3233'), 'temp/1738388067_3520381_1333260105_785c81ed69bacf5bd3acf0740dd72f36_rle_crop_3648430950_0.png'] photo_id : 1333622223 output[photo_id] : [('1333622223', 'papier', 0.63132787, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648431005_0.png'] photo_id : 1333622224 output[photo_id] : [('1333622224', 'film_plastique', 0.29842538, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648430997_0.png'] photo_id : 1333622225 output[photo_id] : [('1333622225', 'carton', 0.38750502, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431047_0.png'] photo_id : 1333622408 output[photo_id] : [('1333622408', 'pehd', 0.54804003, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431068_0.png'] photo_id : 1333622409 output[photo_id] : [('1333622409', 'ela', 0.9422437, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431070_0.png'] photo_id : 1333622410 output[photo_id] : [('1333622410', 'carton', 0.96401936, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431084_0.png'] photo_id : 1333622411 output[photo_id] : [('1333622411', 'pehd', 0.5795134, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431075_0.png'] photo_id : 1333622412 output[photo_id] : [('1333622412', 'papier', 0.8017046, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431097_0.png'] photo_id : 1333622413 output[photo_id] : [('1333622413', 'pehd', 0.5998938, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431129_0.png'] photo_id : 1333622414 output[photo_id] : [('1333622414', 'papier', 0.88338584, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431154_0.png'] photo_id : 1333622415 output[photo_id] : [('1333622415', 'papier', 0.7441626, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431134_0.png'] photo_id : 1333622416 output[photo_id] : [('1333622416', 'metal', 0.75064516, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431136_0.png'] photo_id : 1333622417 output[photo_id] : [('1333622417', 'carton', 0.505206, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431130_0.png'] photo_id : 1333622418 output[photo_id] : [('1333622418', 'barquette_opaque', 0.9982565, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431155_0.png'] photo_id : 1333622419 output[photo_id] : [('1333622419', 'pehd', 0.8375992, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431177_0.png'] photo_id : 1333622420 output[photo_id] : [('1333622420', 'papier', 0.7994184, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431182_0.png'] photo_id : 1333622421 output[photo_id] : [('1333622421', 'carton', 0.6935058, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431200_0.png'] photo_id : 1333622422 output[photo_id] : [('1333622422', 'carton', 0.37736633, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431218_0.png'] photo_id : 1333622423 output[photo_id] : [('1333622423', 'pehd', 0.7649377, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431221_0.png'] photo_id : 1333622424 output[photo_id] : [('1333622424', 'papier', 0.921197, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431237_0.png'] photo_id : 1333622425 output[photo_id] : [('1333622425', 'film_plastique', 0.514225, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431253_0.png'] photo_id : 1333622426 output[photo_id] : [('1333622426', 'carton', 0.2487634, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431228_0.png'] photo_id : 1333622427 output[photo_id] : [('1333622427', 'pehd', 0.5786721, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431249_0.png'] photo_id : 1333622108 output[photo_id] : [('1333622108', 'carton', 0.7624453, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431252_0.png'] photo_id : 1333622127 output[photo_id] : [('1333622127', 'etiquette', 0.7573901, 4151, '3233'), 'temp/1738388067_3520381_1333260105_785c81ed69bacf5bd3acf0740dd72f36_rle_crop_3648430951_0.png'] photo_id : 1333622128 output[photo_id] : [('1333622128', 'papier', 0.48441327, 4151, '3233'), 'temp/1738388067_3520381_1333260105_785c81ed69bacf5bd3acf0740dd72f36_rle_crop_3648430961_0.png'] photo_id : 1333622129 output[photo_id] : [('1333622129', 'carton', 0.5583142, 4151, '3233'), 'temp/1738388067_3520381_1333260105_785c81ed69bacf5bd3acf0740dd72f36_rle_crop_3648430958_0.png'] photo_id : 1333622130 output[photo_id] : [('1333622130', 'papier', 0.37380466, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648431004_0.png'] photo_id : 1333622131 output[photo_id] : [('1333622131', 'carton', 0.37574628, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648430982_0.png'] photo_id : 1333622132 output[photo_id] : [('1333622132', 'pehd', 0.43368033, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648430975_0.png'] photo_id : 1333622133 output[photo_id] : [('1333622133', 'environnement', 0.6058598, 4151, '3233'), 'temp/1738388067_3520381_1333260011_238ed6bd94cccc95dc3bd0a1a8528817_rle_crop_3648431027_0.png'] photo_id : 1333622134 output[photo_id] : [('1333622134', 'barquette_opaque', 0.42733532, 4151, '3233'), 'temp/1738388067_3520381_1333260011_238ed6bd94cccc95dc3bd0a1a8528817_rle_crop_3648431025_0.png'] photo_id : 1333622135 output[photo_id] : [('1333622135', 'film_plastique', 0.40607744, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431060_0.png'] photo_id : 1333622136 output[photo_id] : [('1333622136', 'papier', 0.31638658, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431053_0.png'] photo_id : 1333622138 output[photo_id] : [('1333622138', 'papier', 0.43218634, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431036_0.png'] photo_id : 1333622139 output[photo_id] : [('1333622139', 'ela', 0.7770201, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431051_0.png'] photo_id : 1333622140 output[photo_id] : [('1333622140', 'papier', 0.41757184, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431076_0.png'] photo_id : 1333622141 output[photo_id] : [('1333622141', 'pehd', 0.9843151, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431094_0.png'] photo_id : 1333622142 output[photo_id] : [('1333622142', 'pehd', 0.7751905, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431085_0.png'] photo_id : 1333622143 output[photo_id] : [('1333622143', 'carton', 0.32590365, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431098_0.png'] photo_id : 1333622144 output[photo_id] : [('1333622144', 'carton', 0.3404099, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431081_0.png'] photo_id : 1333622145 output[photo_id] : [('1333622145', 'papier', 0.51398754, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431095_0.png'] photo_id : 1333622146 output[photo_id] : [('1333622146', 'pehd', 0.8144878, 4151, '3233'), 'temp/1738388067_3520381_1333259830_35d5fc38622d425d505eee3d3bcbf1d0_rle_crop_3648431119_0.png'] photo_id : 1333622147 output[photo_id] : [('1333622147', 'pehd', 0.8205434, 4151, '3233'), 'temp/1738388067_3520381_1333259830_35d5fc38622d425d505eee3d3bcbf1d0_rle_crop_3648431121_0.png'] photo_id : 1333622148 output[photo_id] : [('1333622148', 'carton', 0.48971927, 4151, '3233'), 'temp/1738388067_3520381_1333259830_35d5fc38622d425d505eee3d3bcbf1d0_rle_crop_3648431117_0.png'] photo_id : 1333622260 output[photo_id] : [('1333622260', 'papier', 0.35314617, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648430988_0.png'] photo_id : 1333622261 output[photo_id] : [('1333622261', 'metal', 0.2607644, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648431006_0.png'] photo_id : 1333622262 output[photo_id] : [('1333622262', 'carton', 0.42917702, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648430989_0.png'] photo_id : 1333622263 output[photo_id] : [('1333622263', 'ela', 0.630911, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431050_0.png'] photo_id : 1333622264 output[photo_id] : [('1333622264', 'papier', 0.27009103, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431040_0.png'] photo_id : 1333622266 output[photo_id] : [('1333622266', 'carton', 0.46332026, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431057_0.png'] photo_id : 1333622267 output[photo_id] : [('1333622267', 'papier', 0.92719144, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431046_0.png'] photo_id : 1333622268 output[photo_id] : [('1333622268', 'pehd', 0.36149585, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431091_0.png'] photo_id : 1333622269 output[photo_id] : [('1333622269', 'papier', 0.30255696, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431102_0.png'] photo_id : 1333622270 output[photo_id] : [('1333622270', 'pehd', 0.8908304, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431090_0.png'] photo_id : 1333622271 output[photo_id] : [('1333622271', 'carton', 0.8444738, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431067_0.png'] photo_id : 1333622272 output[photo_id] : [('1333622272', 'barquette_opaque', 0.70887333, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431071_0.png'] photo_id : 1333622273 output[photo_id] : [('1333622273', 'carton', 0.859223, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431083_0.png'] photo_id : 1333622274 output[photo_id] : [('1333622274', 'papier', 0.40150693, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431100_0.png'] photo_id : 1333622275 output[photo_id] : [('1333622275', 'papier', 0.89801294, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431080_0.png'] photo_id : 1333622276 output[photo_id] : [('1333622276', 'carton', 0.57444257, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431079_0.png'] photo_id : 1333622277 output[photo_id] : [('1333622277', 'carton', 0.58726674, 4151, '3233'), 'temp/1738388067_3520381_1333259830_35d5fc38622d425d505eee3d3bcbf1d0_rle_crop_3648431113_0.png'] photo_id : 1333622278 output[photo_id] : [('1333622278', 'ela', 0.49583817, 4151, '3233'), 'temp/1738388067_3520381_1333259830_35d5fc38622d425d505eee3d3bcbf1d0_rle_crop_3648431114_0.png'] photo_id : 1333622279 output[photo_id] : [('1333622279', 'papier', 0.25698778, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431147_0.png'] photo_id : 1333622280 output[photo_id] : [('1333622280', 'papier', 0.48999777, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431142_0.png'] photo_id : 1333622281 output[photo_id] : [('1333622281', 'papier', 0.6866106, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431150_0.png'] photo_id : 1333622282 output[photo_id] : [('1333622282', 'ela', 0.42336679, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431133_0.png'] photo_id : 1333622359 output[photo_id] : [('1333622359', 'film_plastique', 0.49769032, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431178_0.png'] photo_id : 1333622360 output[photo_id] : [('1333622360', 'papier', 0.38016713, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431222_0.png'] photo_id : 1333622362 output[photo_id] : [('1333622362', 'papier', 0.32733694, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431217_0.png'] photo_id : 1333622363 output[photo_id] : [('1333622363', 'pehd', 0.46245086, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431215_0.png'] photo_id : 1333622364 output[photo_id] : [('1333622364', 'pehd', 0.66908926, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431238_0.png'] photo_id : 1333622365 output[photo_id] : [('1333622365', 'pehd', 0.661273, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431240_0.png'] photo_id : 1333622367 output[photo_id] : [('1333622367', 'metal', 0.25530714, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431254_0.png'] photo_id : 1333622393 output[photo_id] : [('1333622393', 'ela', 0.9730324, 4151, '3233'), 'temp/1738388067_3520381_1333260105_785c81ed69bacf5bd3acf0740dd72f36_rle_crop_3648430952_0.png'] photo_id : 1333622394 output[photo_id] : [('1333622394', 'barquette_opaque', 0.6862662, 4151, '3233'), 'temp/1738388067_3520381_1333260105_785c81ed69bacf5bd3acf0740dd72f36_rle_crop_3648430971_0.png'] photo_id : 1333622395 output[photo_id] : [('1333622395', 'papier', 0.6662731, 4151, '3233'), 'temp/1738388067_3520381_1333260105_785c81ed69bacf5bd3acf0740dd72f36_rle_crop_3648430966_0.png'] photo_id : 1333622396 output[photo_id] : [('1333622396', 'carton', 0.7387394, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648430974_0.png'] photo_id : 1333622397 output[photo_id] : [('1333622397', 'pehd', 0.5085536, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648431000_0.png'] photo_id : 1333622398 output[photo_id] : [('1333622398', 'carton', 0.7934743, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648430985_0.png'] photo_id : 1333622399 output[photo_id] : [('1333622399', 'carton', 0.99350715, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648430999_0.png'] photo_id : 1333622400 output[photo_id] : [('1333622400', 'pehd', 0.632974, 4151, '3233'), 'temp/1738388067_3520381_1333260011_238ed6bd94cccc95dc3bd0a1a8528817_rle_crop_3648431031_0.png'] photo_id : 1333622401 output[photo_id] : [('1333622401', 'barquette_opaque', 0.98591495, 4151, '3233'), 'temp/1738388067_3520381_1333260011_238ed6bd94cccc95dc3bd0a1a8528817_rle_crop_3648431011_0.png'] photo_id : 1333622402 output[photo_id] : [('1333622402', 'barquette_opaque', 0.9549174, 4151, '3233'), 'temp/1738388067_3520381_1333260011_238ed6bd94cccc95dc3bd0a1a8528817_rle_crop_3648431009_0.png'] photo_id : 1333622403 output[photo_id] : [('1333622403', 'barquette_opaque', 0.6602628, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431056_0.png'] photo_id : 1333622404 output[photo_id] : [('1333622404', 'carton', 0.7266223, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431039_0.png'] photo_id : 1333622405 output[photo_id] : [('1333622405', 'pehd', 0.9006555, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431052_0.png'] photo_id : 1333622406 output[photo_id] : [('1333622406', 'pehd', 0.78835684, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431069_0.png'] photo_id : 1333622407 output[photo_id] : [('1333622407', 'papier', 0.57088923, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431088_0.png'] photo_id : 1333622064 output[photo_id] : [('1333622064', 'pehd', 0.5693954, 4151, '3233'), 'temp/1738388067_3520381_1333260105_785c81ed69bacf5bd3acf0740dd72f36_rle_crop_3648430960_0.png'] photo_id : 1333622065 output[photo_id] : [('1333622065', 'pehd', 0.7932184, 4151, '3233'), 'temp/1738388067_3520381_1333260105_785c81ed69bacf5bd3acf0740dd72f36_rle_crop_3648430955_0.png'] photo_id : 1333622066 output[photo_id] : [('1333622066', 'carton', 0.40960172, 4151, '3233'), 'temp/1738388067_3520381_1333260105_785c81ed69bacf5bd3acf0740dd72f36_rle_crop_3648430967_0.png'] photo_id : 1333622067 output[photo_id] : [('1333622067', 'film_plastique', 0.39996538, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648430977_0.png'] photo_id : 1333622068 output[photo_id] : [('1333622068', 'papier', 0.41445717, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648430980_0.png'] photo_id : 1333622069 output[photo_id] : [('1333622069', 'papier', 0.5096474, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648431007_0.png'] photo_id : 1333622070 output[photo_id] : [('1333622070', 'film_plastique', 0.47845286, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648430986_0.png'] photo_id : 1333622071 output[photo_id] : [('1333622071', 'barquette_opaque', 0.7062259, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648430983_0.png'] photo_id : 1333622072 output[photo_id] : [('1333622072', 'film_plastique', 0.9379504, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648431002_0.png'] photo_id : 1333622073 output[photo_id] : [('1333622073', 'film_plastique', 0.47485268, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648430987_0.png'] photo_id : 1333622074 output[photo_id] : [('1333622074', 'metal', 0.38248587, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648430993_0.png'] photo_id : 1333622075 output[photo_id] : [('1333622075', 'papier', 0.7018493, 4151, '3233'), 'temp/1738388067_3520381_1333260095_550f7347c803ca6b8ed614b4055614ad_rle_crop_3648430991_0.png'] photo_id : 1333622076 output[photo_id] : [('1333622076', 'carton', 0.2943554, 4151, '3233'), 'temp/1738388067_3520381_1333260011_238ed6bd94cccc95dc3bd0a1a8528817_rle_crop_3648431018_0.png'] photo_id : 1333622077 output[photo_id] : [('1333622077', 'carton', 0.33987713, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431038_0.png'] photo_id : 1333622078 output[photo_id] : [('1333622078', 'carton', 0.61529684, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431061_0.png'] photo_id : 1333622079 output[photo_id] : [('1333622079', 'film_plastique', 0.71278, 4151, '3233'), 'temp/1738388067_3520381_1333260000_a50b91f700c07ba00c7fe46f990c4878_rle_crop_3648431033_0.png'] photo_id : 1333622080 output[photo_id] : [('1333622080', 'film_plastique', 0.9505579, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431096_0.png'] photo_id : 1333622081 output[photo_id] : [('1333622081', 'pehd', 0.7569902, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431101_0.png'] photo_id : 1333622082 output[photo_id] : [('1333622082', 'film_plastique', 0.48334682, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431074_0.png'] photo_id : 1333622083 output[photo_id] : [('1333622083', 'carton', 0.3987657, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431087_0.png'] photo_id : 1333622084 output[photo_id] : [('1333622084', 'papier', 0.5783762, 4151, '3233'), 'temp/1738388067_3520381_1333259996_9bf32c4006df52c666db9cd06b5f564d_rle_crop_3648431089_0.png'] photo_id : 1333622085 output[photo_id] : [('1333622085', 'barquette_opaque', 0.4018216, 4151, '3233'), 'temp/1738388067_3520381_1333259830_35d5fc38622d425d505eee3d3bcbf1d0_rle_crop_3648431107_0.png'] photo_id : 1333622086 output[photo_id] : [('1333622086', 'pehd', 0.5431828, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431153_0.png'] photo_id : 1333622087 output[photo_id] : [('1333622087', 'barquette_opaque', 0.994981, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431137_0.png'] photo_id : 1333622088 output[photo_id] : [('1333622088', 'papier', 0.27598715, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431140_0.png'] photo_id : 1333622089 output[photo_id] : [('1333622089', 'pehd', 0.70599324, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431126_0.png'] photo_id : 1333622090 output[photo_id] : [('1333622090', 'film_plastique', 0.6958869, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431139_0.png'] photo_id : 1333622091 output[photo_id] : [('1333622091', 'pehd', 0.8293357, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431144_0.png'] photo_id : 1333622092 output[photo_id] : [('1333622092', 'barquette_opaque', 0.9801728, 4151, '3233'), 'temp/1738388067_3520381_1333259822_3a6e4947a34124d718d02cb91b55f36c_rle_crop_3648431145_0.png'] photo_id : 1333622093 output[photo_id] : [('1333622093', 'barquette_opaque', 0.62986845, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431157_0.png'] photo_id : 1333622094 output[photo_id] : [('1333622094', 'film_plastique', 0.6952105, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431172_0.png'] photo_id : 1333622095 output[photo_id] : [('1333622095', 'pet_clair', 0.3730955, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431163_0.png'] photo_id : 1333622096 output[photo_id] : [('1333622096', 'film_plastique', 0.67768735, 4151, '3233'), 'temp/1738388067_3520381_1333259741_1f9594308c6baf56d9a03f2d1fb431d1_rle_crop_3648431175_0.png'] photo_id : 1333622097 output[photo_id] : [('1333622097', 'papier', 0.5220583, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431210_0.png'] photo_id : 1333622098 output[photo_id] : [('1333622098', 'carton', 0.53292006, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431203_0.png'] photo_id : 1333622099 output[photo_id] : [('1333622099', 'pehd', 0.7749115, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431207_0.png'] photo_id : 1333622100 output[photo_id] : [('1333622100', 'pehd', 0.7833702, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431211_0.png'] photo_id : 1333622101 output[photo_id] : [('1333622101', 'pehd', 0.6998453, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431206_0.png'] photo_id : 1333622102 output[photo_id] : [('1333622102', 'pehd', 0.9718079, 4151, '3233'), 'temp/1738388067_3520381_1333259634_04272da79e26f8b933d044f5510817c7_rle_crop_3648431198_0.png'] photo_id : 1333622103 output[photo_id] : [('1333622103', 'pehd', 0.5893764, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431246_0.png'] photo_id : 1333622104 output[photo_id] : [('1333622104', 'pehd', 0.7258949, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431235_0.png'] photo_id : 1333622105 output[photo_id] : [('1333622105', 'papier', 0.4934611, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431236_0.png'] photo_id : 1333622106 output[photo_id] : [('1333622106', 'film_plastique', 0.64942867, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431233_0.png'] photo_id : 1333622107 output[photo_id] : [('1333622107', 'pehd', 0.52162665, 4151, '3233'), 'temp/1738388067_3520381_1333259603_2429bc73b67e981f286a878879d261f4_rle_crop_3648431242_0.png'] begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 218 time used for this insertion : 0.2205953598022461 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 218 time used for this insertion : 0.022354841232299805 save missing photos in datou_result : time spend for datou_step_exec : 0.005315065383911133 time spend to save output : 0.2453773021697998 total time spend for step 6 : 0.25069236755371094 step7:merge_mask_thcl_custom Sat Feb 1 06:43:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step merge_mask_thcl_custom this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it batch 1 Loaded 319 chid ids of type : 3760 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++As expected we have just one thcl present begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : batch 1 Loaded 218 chid ids of type : 4210 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 218 chid ids of type : 4210 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++End of step merge_mask_thcl_custom Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : merge_mask_thcl_custom we use saveGeneral [1333260105, 1333260095, 1333260011, 1333260000, 1333259996, 1333259830, 1333259822, 1333259741, 1333259634, 1333259603] Looping around the photos to save general results len do output : 10 /1333260105Didn't retrieve data .Didn't retrieve data . /1333260095Didn't retrieve data .Didn't retrieve data . /1333260011Didn't retrieve data .Didn't retrieve data . /1333260000Didn't retrieve data .Didn't retrieve data . /1333259996Didn't retrieve data .Didn't retrieve data . /1333259830Didn't retrieve data .Didn't retrieve data . /1333259822Didn't retrieve data .Didn't retrieve data . /1333259741Didn't retrieve data .Didn't retrieve data . /1333259634Didn't retrieve data .Didn't retrieve data . /1333259603Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260105', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260095', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260011', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260000', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259996', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259830', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259822', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259741', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259634', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259603', None, None, None, None, None, '2533463') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.017332792282104492 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.291236400604248 time spend to save output : 0.01871633529663086 total time spend for step 7 : 1.309952735900879 step8:rle_unique_nms_with_priority Sat Feb 1 06:43:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms nb_obj : 15 nb_hashtags : 8 time to prepare the origin masks : 35.74179172515869 time for calcul the mask position with numpy : 1.6807875633239746 nb_pixel_total : 7627538 time to create 1 rle with new method : 1.554983139038086 time for calcul the mask position with numpy : 0.04303240776062012 nb_pixel_total : 42214 time to create 1 rle with old method : 0.05095267295837402 time for calcul the mask position with numpy : 0.04431486129760742 nb_pixel_total : 36932 time to create 1 rle with old method : 0.04333949089050293 time for calcul the mask position with numpy : 0.04344367980957031 nb_pixel_total : 58111 time to create 1 rle with old method : 0.07067441940307617 time for calcul the mask position with numpy : 0.04785418510437012 nb_pixel_total : 46758 time to create 1 rle with old method : 0.05543947219848633 time for calcul the mask position with numpy : 0.04272747039794922 nb_pixel_total : 95726 time to create 1 rle with old method : 0.11095452308654785 time for calcul the mask position with numpy : 0.04251718521118164 nb_pixel_total : 38028 time to create 1 rle with old method : 0.04445362091064453 time for calcul the mask position with numpy : 0.04743838310241699 nb_pixel_total : 39198 time to create 1 rle with old method : 0.04709267616271973 time for calcul the mask position with numpy : 0.04167532920837402 nb_pixel_total : 57753 time to create 1 rle with old method : 0.06248807907104492 time for calcul the mask position with numpy : 0.04557657241821289 nb_pixel_total : 32804 time to create 1 rle with old method : 0.037317752838134766 time for calcul the mask position with numpy : 0.04824566841125488 nb_pixel_total : 27141 time to create 1 rle with old method : 0.03216099739074707 time for calcul the mask position with numpy : 0.025266408920288086 nb_pixel_total : 3127 time to create 1 rle with old method : 0.003454923629760742 time for calcul the mask position with numpy : 0.027940750122070312 nb_pixel_total : 20844 time to create 1 rle with old method : 0.025034189224243164 time for calcul the mask position with numpy : 0.028102874755859375 nb_pixel_total : 71847 time to create 1 rle with old method : 0.08333516120910645 time for calcul the mask position with numpy : 0.026380062103271484 nb_pixel_total : 50930 time to create 1 rle with old method : 0.05520367622375488 time for calcul the mask position with numpy : 0.023828744888305664 nb_pixel_total : 45449 time to create 1 rle with old method : 0.051339149475097656 create new chi : 4.640946626663208 time to delete rle : 0.04977226257324219 batch 1 Loaded 16 chid ids of type : 4211 Number RLEs to save : 10009 TO DO : save crop sub photo not yet done ! save time : 0.8348636627197266 nb_obj : 25 nb_hashtags : 7 time to prepare the origin masks : 39.81879901885986 time for calcul the mask position with numpy : 1.3816628456115723 nb_pixel_total : 6976578 time to create 1 rle with new method : 1.7835581302642822 time for calcul the mask position with numpy : 0.042177677154541016 nb_pixel_total : 11672 time to create 1 rle with old method : 0.013406753540039062 time for calcul the mask position with numpy : 0.0525662899017334 nb_pixel_total : 139746 time to create 1 rle with old method : 0.16113829612731934 time for calcul the mask position with numpy : 0.04104900360107422 nb_pixel_total : 10219 time to create 1 rle with old method : 0.012398004531860352 time for calcul the mask position with numpy : 0.04122185707092285 nb_pixel_total : 10309 time to create 1 rle with old method : 0.011706829071044922 time for calcul the mask position with numpy : 0.042550086975097656 nb_pixel_total : 65397 time to create 1 rle with old method : 0.07183980941772461 time for calcul the mask position with numpy : 0.04256606101989746 nb_pixel_total : 69480 time to create 1 rle with old method : 0.10579180717468262 time for calcul the mask position with numpy : 0.03601884841918945 nb_pixel_total : 82465 time to create 1 rle with old method : 0.10089659690856934 time for calcul the mask position with numpy : 0.04433774948120117 nb_pixel_total : 115343 time to create 1 rle with old method : 0.13408493995666504 time for calcul the mask position with numpy : 0.041162729263305664 nb_pixel_total : 42509 time to create 1 rle with old method : 0.05258607864379883 time for calcul the mask position with numpy : 0.04246354103088379 nb_pixel_total : 29954 time to create 1 rle with old method : 0.0340580940246582 time for calcul the mask position with numpy : 0.04170489311218262 nb_pixel_total : 20375 time to create 1 rle with old method : 0.023276567459106445 time for calcul the mask position with numpy : 0.04128217697143555 nb_pixel_total : 59560 time to create 1 rle with old method : 0.07318377494812012 time for calcul the mask position with numpy : 0.0397038459777832 nb_pixel_total : 130903 time to create 1 rle with old method : 0.15021729469299316 time for calcul the mask position with numpy : 0.029729127883911133 nb_pixel_total : 26722 time to create 1 rle with old method : 0.02895379066467285 time for calcul the mask position with numpy : 0.02823638916015625 nb_pixel_total : 30442 time to create 1 rle with old method : 0.03532600402832031 time for calcul the mask position with numpy : 0.027925491333007812 nb_pixel_total : 77948 time to create 1 rle with old method : 0.09228873252868652 time for calcul the mask position with numpy : 0.026453495025634766 nb_pixel_total : 51040 time to create 1 rle with old method : 0.07303094863891602 time for calcul the mask position with numpy : 0.02708578109741211 nb_pixel_total : 27268 time to create 1 rle with old method : 0.03078627586364746 time for calcul the mask position with numpy : 0.02785348892211914 nb_pixel_total : 47783 time to create 1 rle with old method : 0.05422544479370117 time for calcul the mask position with numpy : 0.026994705200195312 nb_pixel_total : 49031 time to create 1 rle with old method : 0.053304195404052734 time for calcul the mask position with numpy : 0.03045487403869629 nb_pixel_total : 10357 time to create 1 rle with old method : 0.02072596549987793 time for calcul the mask position with numpy : 0.029714345932006836 nb_pixel_total : 70728 time to create 1 rle with old method : 0.0924825668334961 time for calcul the mask position with numpy : 0.026165485382080078 nb_pixel_total : 19333 time to create 1 rle with old method : 0.022557735443115234 time for calcul the mask position with numpy : 0.04364347457885742 nb_pixel_total : 87839 time to create 1 rle with old method : 0.09978413581848145 time for calcul the mask position with numpy : 0.04342222213745117 nb_pixel_total : 31399 time to create 1 rle with old method : 0.03618669509887695 create new chi : 5.719395875930786 time to delete rle : 0.0015819072723388672 batch 1 Loaded 26 chid ids of type : 4211 Number RLEs to save : 16545 TO DO : save crop sub photo not yet done ! save time : 3.0058324337005615 nb_obj : 9 nb_hashtags : 5 time to prepare the origin masks : 18.412712574005127 time for calcul the mask position with numpy : 1.1045708656311035 nb_pixel_total : 7913344 time to create 1 rle with new method : 1.518550157546997 time for calcul the mask position with numpy : 0.06275463104248047 nb_pixel_total : 22041 time to create 1 rle with old method : 0.05890989303588867 time for calcul the mask position with numpy : 0.07179832458496094 nb_pixel_total : 25444 time to create 1 rle with old method : 0.03284788131713867 time for calcul the mask position with numpy : 0.04594755172729492 nb_pixel_total : 8073 time to create 1 rle with old method : 0.009919404983520508 time for calcul the mask position with numpy : 0.0455780029296875 nb_pixel_total : 22861 time to create 1 rle with old method : 0.03554272651672363 time for calcul the mask position with numpy : 0.03210306167602539 nb_pixel_total : 2357 time to create 1 rle with old method : 0.0037462711334228516 time for calcul the mask position with numpy : 0.03214406967163086 nb_pixel_total : 166055 time to create 1 rle with new method : 1.9620847702026367 time for calcul the mask position with numpy : 0.03046107292175293 nb_pixel_total : 32178 time to create 1 rle with old method : 0.047579288482666016 time for calcul the mask position with numpy : 0.03255748748779297 nb_pixel_total : 80394 time to create 1 rle with old method : 0.0959482192993164 time for calcul the mask position with numpy : 0.026872873306274414 nb_pixel_total : 21653 time to create 1 rle with old method : 0.023136377334594727 create new chi : 5.362383127212524 time to delete rle : 0.0006754398345947266 batch 1 Loaded 10 chid ids of type : 4211 Number RLEs to save : 6132 TO DO : save crop sub photo not yet done ! save time : 0.44136476516723633 nb_obj : 25 nb_hashtags : 6 time to prepare the origin masks : 39.86084008216858 time for calcul the mask position with numpy : 1.850053310394287 nb_pixel_total : 7092704 time to create 1 rle with new method : 1.8357808589935303 time for calcul the mask position with numpy : 0.05278348922729492 nb_pixel_total : 13133 time to create 1 rle with old method : 0.014347314834594727 time for calcul the mask position with numpy : 0.050048828125 nb_pixel_total : 35410 time to create 1 rle with old method : 0.04012727737426758 time for calcul the mask position with numpy : 0.052288055419921875 nb_pixel_total : 80775 time to create 1 rle with old method : 0.09310507774353027 time for calcul the mask position with numpy : 0.04768490791320801 nb_pixel_total : 28248 time to create 1 rle with old method : 0.03381013870239258 time for calcul the mask position with numpy : 0.05433177947998047 nb_pixel_total : 18365 time to create 1 rle with old method : 0.029293298721313477 time for calcul the mask position with numpy : 0.054566144943237305 nb_pixel_total : 31531 time to create 1 rle with old method : 0.035352468490600586 time for calcul the mask position with numpy : 0.05507636070251465 nb_pixel_total : 37862 time to create 1 rle with old method : 0.04361128807067871 time for calcul the mask position with numpy : 0.05927920341491699 nb_pixel_total : 35414 time to create 1 rle with old method : 0.04527568817138672 time for calcul the mask position with numpy : 0.05622696876525879 nb_pixel_total : 64122 time to create 1 rle with old method : 0.07115602493286133 time for calcul the mask position with numpy : 0.056661128997802734 nb_pixel_total : 15088 time to create 1 rle with old method : 0.02298259735107422 time for calcul the mask position with numpy : 0.049536705017089844 nb_pixel_total : 26807 time to create 1 rle with old method : 0.03183555603027344 time for calcul the mask position with numpy : 0.06777381896972656 nb_pixel_total : 102772 time to create 1 rle with old method : 0.12202787399291992 time for calcul the mask position with numpy : 0.048540353775024414 nb_pixel_total : 35407 time to create 1 rle with old method : 0.04157543182373047 time for calcul the mask position with numpy : 0.05779910087585449 nb_pixel_total : 44313 time to create 1 rle with old method : 0.057301998138427734 time for calcul the mask position with numpy : 0.057425737380981445 nb_pixel_total : 24011 time to create 1 rle with old method : 0.030144929885864258 time for calcul the mask position with numpy : 0.06742572784423828 nb_pixel_total : 113782 time to create 1 rle with old method : 0.13763809204101562 time for calcul the mask position with numpy : 0.05189228057861328 nb_pixel_total : 124029 time to create 1 rle with old method : 0.15352106094360352 time for calcul the mask position with numpy : 0.05668473243713379 nb_pixel_total : 19047 time to create 1 rle with old method : 0.026410341262817383 time for calcul the mask position with numpy : 0.05821418762207031 nb_pixel_total : 19863 time to create 1 rle with old method : 0.05584979057312012 time for calcul the mask position with numpy : 0.11202263832092285 nb_pixel_total : 25429 time to create 1 rle with old method : 0.04145979881286621 time for calcul the mask position with numpy : 0.058681488037109375 nb_pixel_total : 35331 time to create 1 rle with old method : 0.05780911445617676 time for calcul the mask position with numpy : 0.04237651824951172 nb_pixel_total : 56648 time to create 1 rle with old method : 0.06855058670043945 time for calcul the mask position with numpy : 0.04754829406738281 nb_pixel_total : 21803 time to create 1 rle with old method : 0.024454593658447266 time for calcul the mask position with numpy : 0.042670249938964844 nb_pixel_total : 40130 time to create 1 rle with old method : 0.04719972610473633 time for calcul the mask position with numpy : 0.04557013511657715 nb_pixel_total : 152376 time to create 1 rle with new method : 0.622626781463623 create new chi : 7.140482664108276 time to delete rle : 0.00244140625 batch 1 Loaded 26 chid ids of type : 4211 Number RLEs to save : 17651 TO DO : save crop sub photo not yet done ! save time : 1.492619276046753 nb_obj : 31 nb_hashtags : 6 time to prepare the origin masks : 18.066423416137695 time for calcul the mask position with numpy : 0.9067316055297852 nb_pixel_total : 6711380 time to create 1 rle with new method : 1.518829584121704 time for calcul the mask position with numpy : 0.03572726249694824 nb_pixel_total : 31468 time to create 1 rle with old method : 0.037154436111450195 time for calcul the mask position with numpy : 0.03602004051208496 nb_pixel_total : 60336 time to create 1 rle with old method : 0.06955575942993164 time for calcul the mask position with numpy : 0.03683638572692871 nb_pixel_total : 37915 time to create 1 rle with old method : 0.04333853721618652 time for calcul the mask position with numpy : 0.03519272804260254 nb_pixel_total : 31943 time to create 1 rle with old method : 0.03641152381896973 time for calcul the mask position with numpy : 0.03664755821228027 nb_pixel_total : 162986 time to create 1 rle with new method : 1.2897520065307617 time for calcul the mask position with numpy : 0.035897254943847656 nb_pixel_total : 27024 time to create 1 rle with old method : 0.031850337982177734 time for calcul the mask position with numpy : 0.035092830657958984 nb_pixel_total : 24471 time to create 1 rle with old method : 0.030287981033325195 time for calcul the mask position with numpy : 0.03571200370788574 nb_pixel_total : 105462 time to create 1 rle with old method : 0.12515592575073242 time for calcul the mask position with numpy : 0.03536534309387207 nb_pixel_total : 48763 time to create 1 rle with old method : 0.0562434196472168 time for calcul the mask position with numpy : 0.03461194038391113 nb_pixel_total : 20425 time to create 1 rle with old method : 0.026197433471679688 time for calcul the mask position with numpy : 0.03724265098571777 nb_pixel_total : 56739 time to create 1 rle with old method : 0.06699013710021973 time for calcul the mask position with numpy : 0.03769874572753906 nb_pixel_total : 12817 time to create 1 rle with old method : 0.014996051788330078 time for calcul the mask position with numpy : 0.034552812576293945 nb_pixel_total : 4931 time to create 1 rle with old method : 0.005871772766113281 time for calcul the mask position with numpy : 0.035498857498168945 nb_pixel_total : 69679 time to create 1 rle with old method : 0.07851743698120117 time for calcul the mask position with numpy : 0.03719186782836914 nb_pixel_total : 43494 time to create 1 rle with old method : 0.0508420467376709 time for calcul the mask position with numpy : 0.03538680076599121 nb_pixel_total : 20389 time to create 1 rle with old method : 0.023036479949951172 time for calcul the mask position with numpy : 0.03490090370178223 nb_pixel_total : 105445 time to create 1 rle with old method : 0.13521814346313477 time for calcul the mask position with numpy : 0.037987470626831055 nb_pixel_total : 61032 time to create 1 rle with old method : 0.11008906364440918 time for calcul the mask position with numpy : 0.04148983955383301 nb_pixel_total : 102211 time to create 1 rle with old method : 0.11352205276489258 time for calcul the mask position with numpy : 0.034813880920410156 nb_pixel_total : 74535 time to create 1 rle with old method : 0.09378910064697266 time for calcul the mask position with numpy : 0.03493642807006836 nb_pixel_total : 36721 time to create 1 rle with old method : 0.043534278869628906 time for calcul the mask position with numpy : 0.035387516021728516 nb_pixel_total : 89739 time to create 1 rle with old method : 0.10789275169372559 time for calcul the mask position with numpy : 0.03526926040649414 nb_pixel_total : 67255 time to create 1 rle with old method : 0.08301568031311035 time for calcul the mask position with numpy : 0.03539609909057617 nb_pixel_total : 53856 time to create 1 rle with old method : 0.0596165657043457 time for calcul the mask position with numpy : 0.03525352478027344 nb_pixel_total : 38779 time to create 1 rle with old method : 0.04667782783508301 time for calcul the mask position with numpy : 0.034822940826416016 nb_pixel_total : 37315 time to create 1 rle with old method : 0.04375171661376953 time for calcul the mask position with numpy : 0.04029703140258789 nb_pixel_total : 23244 time to create 1 rle with old method : 0.027353763580322266 time for calcul the mask position with numpy : 0.03743481636047363 nb_pixel_total : 17914 time to create 1 rle with old method : 0.02085256576538086 time for calcul the mask position with numpy : 0.03622245788574219 nb_pixel_total : 14881 time to create 1 rle with old method : 0.0182037353515625 time for calcul the mask position with numpy : 0.03496122360229492 nb_pixel_total : 46065 time to create 1 rle with old method : 0.06725382804870605 time for calcul the mask position with numpy : 0.03483223915100098 nb_pixel_total : 55186 time to create 1 rle with old method : 0.06218528747558594 create new chi : 6.640732765197754 time to delete rle : 0.002259492874145508 batch 1 Loaded 32 chid ids of type : 4211 Number RLEs to save : 18645 TO DO : save crop sub photo not yet done ! save time : 1.421116828918457 nb_obj : 14 nb_hashtags : 6 time to prepare the origin masks : 29.47978663444519 time for calcul the mask position with numpy : 0.6791651248931885 nb_pixel_total : 7336006 time to create 1 rle with new method : 1.5456972122192383 time for calcul the mask position with numpy : 0.05089306831359863 nb_pixel_total : 31218 time to create 1 rle with old method : 0.035779714584350586 time for calcul the mask position with numpy : 0.052307844161987305 nb_pixel_total : 107425 time to create 1 rle with old method : 0.1148982048034668 time for calcul the mask position with numpy : 0.05240988731384277 nb_pixel_total : 207304 time to create 1 rle with new method : 0.727433443069458 time for calcul the mask position with numpy : 0.07500982284545898 nb_pixel_total : 45611 time to create 1 rle with old method : 0.05140328407287598 time for calcul the mask position with numpy : 0.0511171817779541 nb_pixel_total : 190771 time to create 1 rle with new method : 1.3241167068481445 time for calcul the mask position with numpy : 0.047760009765625 nb_pixel_total : 34045 time to create 1 rle with old method : 0.03755378723144531 time for calcul the mask position with numpy : 0.05109214782714844 nb_pixel_total : 80645 time to create 1 rle with old method : 0.09089469909667969 time for calcul the mask position with numpy : 0.06011319160461426 nb_pixel_total : 53713 time to create 1 rle with old method : 0.06117081642150879 time for calcul the mask position with numpy : 0.04221343994140625 nb_pixel_total : 30421 time to create 1 rle with old method : 0.036583662033081055 time for calcul the mask position with numpy : 0.03510546684265137 nb_pixel_total : 51326 time to create 1 rle with old method : 0.057761192321777344 time for calcul the mask position with numpy : 0.030030250549316406 nb_pixel_total : 70926 time to create 1 rle with old method : 0.08857107162475586 time for calcul the mask position with numpy : 0.03186845779418945 nb_pixel_total : 15805 time to create 1 rle with old method : 0.017184019088745117 time for calcul the mask position with numpy : 0.03268241882324219 nb_pixel_total : 13604 time to create 1 rle with old method : 0.015012264251708984 time for calcul the mask position with numpy : 0.029894351959228516 nb_pixel_total : 25580 time to create 1 rle with old method : 0.02586841583251953 create new chi : 5.687560319900513 time to delete rle : 0.0014395713806152344 batch 1 Loaded 15 chid ids of type : 4211 Number RLEs to save : 11196 TO DO : save crop sub photo not yet done ! save time : 1.001706838607788 nb_obj : 24 nb_hashtags : 8 time to prepare the origin masks : 30.130526065826416 time for calcul the mask position with numpy : 1.2004656791687012 nb_pixel_total : 6978501 time to create 1 rle with new method : 0.4888575077056885 time for calcul the mask position with numpy : 0.04256463050842285 nb_pixel_total : 28461 time to create 1 rle with old method : 0.03175616264343262 time for calcul the mask position with numpy : 0.0434422492980957 nb_pixel_total : 3963 time to create 1 rle with old method : 0.0048770904541015625 time for calcul the mask position with numpy : 0.04998040199279785 nb_pixel_total : 176459 time to create 1 rle with new method : 0.7889931201934814 time for calcul the mask position with numpy : 0.04659891128540039 nb_pixel_total : 13001 time to create 1 rle with old method : 0.015180587768554688 time for calcul the mask position with numpy : 0.043852806091308594 nb_pixel_total : 60521 time to create 1 rle with old method : 0.07553529739379883 time for calcul the mask position with numpy : 0.047144412994384766 nb_pixel_total : 17088 time to create 1 rle with old method : 0.02199101448059082 time for calcul the mask position with numpy : 0.046553850173950195 nb_pixel_total : 43003 time to create 1 rle with old method : 0.05338430404663086 time for calcul the mask position with numpy : 0.026045560836791992 nb_pixel_total : 53628 time to create 1 rle with old method : 0.05886960029602051 time for calcul the mask position with numpy : 0.02466726303100586 nb_pixel_total : 21282 time to create 1 rle with old method : 0.02913951873779297 time for calcul the mask position with numpy : 0.026401281356811523 nb_pixel_total : 47102 time to create 1 rle with old method : 0.06136059761047363 time for calcul the mask position with numpy : 0.03252696990966797 nb_pixel_total : 39333 time to create 1 rle with old method : 0.042105913162231445 time for calcul the mask position with numpy : 0.02696967124938965 nb_pixel_total : 72272 time to create 1 rle with old method : 0.08336973190307617 time for calcul the mask position with numpy : 0.028240680694580078 nb_pixel_total : 41717 time to create 1 rle with old method : 0.04863142967224121 time for calcul the mask position with numpy : 0.03667593002319336 nb_pixel_total : 165018 time to create 1 rle with new method : 1.8700671195983887 time for calcul the mask position with numpy : 0.0475313663482666 nb_pixel_total : 11491 time to create 1 rle with old method : 0.013618707656860352 time for calcul the mask position with numpy : 0.05249285697937012 nb_pixel_total : 82751 time to create 1 rle with old method : 0.09767389297485352 time for calcul the mask position with numpy : 0.0430750846862793 nb_pixel_total : 22544 time to create 1 rle with old method : 0.025716543197631836 time for calcul the mask position with numpy : 0.04420185089111328 nb_pixel_total : 38714 time to create 1 rle with old method : 0.05939316749572754 time for calcul the mask position with numpy : 0.041944026947021484 nb_pixel_total : 69521 time to create 1 rle with old method : 0.08952116966247559 time for calcul the mask position with numpy : 0.044342756271362305 nb_pixel_total : 57020 time to create 1 rle with old method : 0.06688928604125977 time for calcul the mask position with numpy : 0.04276609420776367 nb_pixel_total : 24178 time to create 1 rle with old method : 0.030156850814819336 time for calcul the mask position with numpy : 0.04217195510864258 nb_pixel_total : 56650 time to create 1 rle with old method : 0.0696115493774414 time for calcul the mask position with numpy : 0.03950691223144531 nb_pixel_total : 94474 time to create 1 rle with old method : 0.10642838478088379 time for calcul the mask position with numpy : 0.0338139533996582 nb_pixel_total : 75708 time to create 1 rle with old method : 0.08999204635620117 create new chi : 6.610063791275024 time to delete rle : 0.0023484230041503906 batch 1 Loaded 25 chid ids of type : 4211 Number RLEs to save : 16363 TO DO : save crop sub photo not yet done ! save time : 1.441066026687622 nb_obj : 23 nb_hashtags : 7 time to prepare the origin masks : 33.460830211639404 time for calcul the mask position with numpy : 1.1828384399414062 nb_pixel_total : 6778978 time to create 1 rle with new method : 1.4589660167694092 time for calcul the mask position with numpy : 0.04393792152404785 nb_pixel_total : 604 time to create 1 rle with old method : 0.0008776187896728516 time for calcul the mask position with numpy : 0.045009613037109375 nb_pixel_total : 147708 time to create 1 rle with old method : 0.17338871955871582 time for calcul the mask position with numpy : 0.040473222732543945 nb_pixel_total : 32907 time to create 1 rle with old method : 0.037442684173583984 time for calcul the mask position with numpy : 0.040128469467163086 nb_pixel_total : 1371 time to create 1 rle with old method : 0.0015017986297607422 time for calcul the mask position with numpy : 0.04022097587585449 nb_pixel_total : 36075 time to create 1 rle with old method : 0.04222226142883301 time for calcul the mask position with numpy : 0.043581247329711914 nb_pixel_total : 20961 time to create 1 rle with old method : 0.025212526321411133 time for calcul the mask position with numpy : 0.04263663291931152 nb_pixel_total : 58042 time to create 1 rle with old method : 0.07172846794128418 time for calcul the mask position with numpy : 0.042929887771606445 nb_pixel_total : 71970 time to create 1 rle with old method : 0.08146047592163086 time for calcul the mask position with numpy : 0.042171478271484375 nb_pixel_total : 67570 time to create 1 rle with old method : 0.07643747329711914 time for calcul the mask position with numpy : 0.04105114936828613 nb_pixel_total : 15288 time to create 1 rle with old method : 0.01738905906677246 time for calcul the mask position with numpy : 0.04238557815551758 nb_pixel_total : 138479 time to create 1 rle with old method : 0.18537211418151855 time for calcul the mask position with numpy : 0.05422353744506836 nb_pixel_total : 49851 time to create 1 rle with old method : 0.059448957443237305 time for calcul the mask position with numpy : 0.047791242599487305 nb_pixel_total : 280690 time to create 1 rle with new method : 1.0256714820861816 time for calcul the mask position with numpy : 0.04235386848449707 nb_pixel_total : 12386 time to create 1 rle with old method : 0.014486551284790039 time for calcul the mask position with numpy : 0.04688310623168945 nb_pixel_total : 66156 time to create 1 rle with old method : 0.07454133033752441 time for calcul the mask position with numpy : 0.04612588882446289 nb_pixel_total : 67264 time to create 1 rle with old method : 0.07505154609680176 time for calcul the mask position with numpy : 0.04900693893432617 nb_pixel_total : 164457 time to create 1 rle with new method : 1.2879726886749268 time for calcul the mask position with numpy : 0.04755401611328125 nb_pixel_total : 32358 time to create 1 rle with old method : 0.03511643409729004 time for calcul the mask position with numpy : 0.045068979263305664 nb_pixel_total : 19129 time to create 1 rle with old method : 0.021936416625976562 time for calcul the mask position with numpy : 0.04324531555175781 nb_pixel_total : 50525 time to create 1 rle with old method : 0.055538177490234375 time for calcul the mask position with numpy : 0.042679548263549805 nb_pixel_total : 35876 time to create 1 rle with old method : 0.041864633560180664 time for calcul the mask position with numpy : 0.0252077579498291 nb_pixel_total : 32740 time to create 1 rle with old method : 0.03545832633972168 time for calcul the mask position with numpy : 0.026538372039794922 nb_pixel_total : 113015 time to create 1 rle with old method : 0.12335038185119629 create new chi : 7.302040338516235 time to delete rle : 0.0019829273223876953 batch 1 Loaded 24 chid ids of type : 4211 Number RLEs to save : 15325 TO DO : save crop sub photo not yet done ! save time : 1.1991822719573975 nb_obj : 29 nb_hashtags : 4 time to prepare the origin masks : 17.438456058502197 time for calcul the mask position with numpy : 3.214430570602417 nb_pixel_total : 6847793 time to create 1 rle with new method : 1.9780302047729492 time for calcul the mask position with numpy : 0.03306770324707031 nb_pixel_total : 30662 time to create 1 rle with old method : 0.03350663185119629 time for calcul the mask position with numpy : 0.03376460075378418 nb_pixel_total : 72868 time to create 1 rle with old method : 0.07896757125854492 time for calcul the mask position with numpy : 0.03415346145629883 nb_pixel_total : 41708 time to create 1 rle with old method : 0.04710221290588379 time for calcul the mask position with numpy : 0.03316140174865723 nb_pixel_total : 27883 time to create 1 rle with old method : 0.03090381622314453 time for calcul the mask position with numpy : 0.03289437294006348 nb_pixel_total : 7245 time to create 1 rle with old method : 0.007580280303955078 time for calcul the mask position with numpy : 0.033310651779174805 nb_pixel_total : 46516 time to create 1 rle with old method : 0.04886937141418457 time for calcul the mask position with numpy : 0.03392982482910156 nb_pixel_total : 46134 time to create 1 rle with old method : 0.048796892166137695 time for calcul the mask position with numpy : 0.0324711799621582 nb_pixel_total : 7032 time to create 1 rle with old method : 0.007227182388305664 time for calcul the mask position with numpy : 0.033132314682006836 nb_pixel_total : 438 time to create 1 rle with old method : 0.0007417201995849609 time for calcul the mask position with numpy : 0.03523707389831543 nb_pixel_total : 46804 time to create 1 rle with old method : 0.048709869384765625 time for calcul the mask position with numpy : 0.03501081466674805 nb_pixel_total : 160238 time to create 1 rle with new method : 1.788287878036499 time for calcul the mask position with numpy : 0.04518842697143555 nb_pixel_total : 41338 time to create 1 rle with old method : 0.04482102394104004 time for calcul the mask position with numpy : 0.03807854652404785 nb_pixel_total : 62911 time to create 1 rle with old method : 0.07219505310058594 time for calcul the mask position with numpy : 0.0343472957611084 nb_pixel_total : 9574 time to create 1 rle with old method : 0.011497259140014648 time for calcul the mask position with numpy : 0.038364410400390625 nb_pixel_total : 138000 time to create 1 rle with old method : 0.16866564750671387 time for calcul the mask position with numpy : 0.03342413902282715 nb_pixel_total : 51693 time to create 1 rle with old method : 0.05390357971191406 time for calcul the mask position with numpy : 0.033735036849975586 nb_pixel_total : 12787 time to create 1 rle with old method : 0.013147830963134766 time for calcul the mask position with numpy : 0.03303933143615723 nb_pixel_total : 27785 time to create 1 rle with old method : 0.02891087532043457 time for calcul the mask position with numpy : 0.03467392921447754 nb_pixel_total : 75552 time to create 1 rle with old method : 0.07879829406738281 time for calcul the mask position with numpy : 0.04094552993774414 nb_pixel_total : 54389 time to create 1 rle with old method : 0.05990958213806152 time for calcul the mask position with numpy : 0.037906646728515625 nb_pixel_total : 35743 time to create 1 rle with old method : 0.04741215705871582 time for calcul the mask position with numpy : 0.041654109954833984 nb_pixel_total : 33820 time to create 1 rle with old method : 0.036992549896240234 time for calcul the mask position with numpy : 0.03390669822692871 nb_pixel_total : 83437 time to create 1 rle with old method : 0.0899348258972168 time for calcul the mask position with numpy : 0.03398323059082031 nb_pixel_total : 45987 time to create 1 rle with old method : 0.05465292930603027 time for calcul the mask position with numpy : 0.03406691551208496 nb_pixel_total : 29403 time to create 1 rle with old method : 0.035350799560546875 time for calcul the mask position with numpy : 0.042433977127075195 nb_pixel_total : 165156 time to create 1 rle with new method : 1.6300852298736572 time for calcul the mask position with numpy : 0.04097700119018555 nb_pixel_total : 31800 time to create 1 rle with old method : 0.04280376434326172 time for calcul the mask position with numpy : 0.03414630889892578 nb_pixel_total : 45752 time to create 1 rle with old method : 0.04788041114807129 time for calcul the mask position with numpy : 0.03741264343261719 nb_pixel_total : 13952 time to create 1 rle with old method : 0.017134428024291992 create new chi : 11.013120889663696 time to delete rle : 0.0026922225952148438 batch 1 Loaded 30 chid ids of type : 4211 Number RLEs to save : 17355 TO DO : save crop sub photo not yet done ! save time : 1.2203080654144287 nb_obj : 23 nb_hashtags : 7 time to prepare the origin masks : 30.636170625686646 time for calcul the mask position with numpy : 0.7829604148864746 nb_pixel_total : 7282813 time to create 1 rle with new method : 0.9733784198760986 time for calcul the mask position with numpy : 0.045867204666137695 nb_pixel_total : 59061 time to create 1 rle with old method : 0.05935049057006836 time for calcul the mask position with numpy : 0.04537630081176758 nb_pixel_total : 38306 time to create 1 rle with old method : 0.04146313667297363 time for calcul the mask position with numpy : 0.0466153621673584 nb_pixel_total : 85291 time to create 1 rle with old method : 0.09099555015563965 time for calcul the mask position with numpy : 0.04435539245605469 nb_pixel_total : 31576 time to create 1 rle with old method : 0.03560209274291992 time for calcul the mask position with numpy : 0.040685415267944336 nb_pixel_total : 13434 time to create 1 rle with old method : 0.01529693603515625 time for calcul the mask position with numpy : 0.04050922393798828 nb_pixel_total : 31388 time to create 1 rle with old method : 0.033948421478271484 time for calcul the mask position with numpy : 0.04381585121154785 nb_pixel_total : 27719 time to create 1 rle with old method : 0.031241416931152344 time for calcul the mask position with numpy : 0.043851613998413086 nb_pixel_total : 32641 time to create 1 rle with old method : 0.04011654853820801 time for calcul the mask position with numpy : 0.04641556739807129 nb_pixel_total : 73694 time to create 1 rle with old method : 0.08749079704284668 time for calcul the mask position with numpy : 0.05701804161071777 nb_pixel_total : 7227 time to create 1 rle with old method : 0.010215997695922852 time for calcul the mask position with numpy : 0.052165985107421875 nb_pixel_total : 8329 time to create 1 rle with old method : 0.011437416076660156 time for calcul the mask position with numpy : 0.04448556900024414 nb_pixel_total : 77505 time to create 1 rle with old method : 0.11015772819519043 time for calcul the mask position with numpy : 0.04227924346923828 nb_pixel_total : 91656 time to create 1 rle with old method : 0.10171389579772949 time for calcul the mask position with numpy : 0.04097127914428711 nb_pixel_total : 74469 time to create 1 rle with old method : 0.09288716316223145 time for calcul the mask position with numpy : 0.04137611389160156 nb_pixel_total : 67773 time to create 1 rle with old method : 0.07960844039916992 time for calcul the mask position with numpy : 0.045851707458496094 nb_pixel_total : 18700 time to create 1 rle with old method : 0.03307938575744629 time for calcul the mask position with numpy : 0.04580831527709961 nb_pixel_total : 100262 time to create 1 rle with old method : 0.11380863189697266 time for calcul the mask position with numpy : 0.04163551330566406 nb_pixel_total : 36086 time to create 1 rle with old method : 0.05288863182067871 time for calcul the mask position with numpy : 0.042737722396850586 nb_pixel_total : 43716 time to create 1 rle with old method : 0.04758501052856445 time for calcul the mask position with numpy : 0.041440725326538086 nb_pixel_total : 21202 time to create 1 rle with old method : 0.024113178253173828 time for calcul the mask position with numpy : 0.04922628402709961 nb_pixel_total : 51082 time to create 1 rle with old method : 0.07647466659545898 time for calcul the mask position with numpy : 0.04133439064025879 nb_pixel_total : 1556 time to create 1 rle with old method : 0.0018558502197265625 time for calcul the mask position with numpy : 0.039351701736450195 nb_pixel_total : 18914 time to create 1 rle with old method : 0.024741172790527344 create new chi : 4.04515814781189 time to delete rle : 0.001855611801147461 batch 1 Loaded 24 chid ids of type : 4211 Number RLEs to save : 15135 TO DO : save crop sub photo not yet done ! save time : 0.9522171020507812 map_output_result : {1333260105: (0.0, 'Should be the crop_list due to order', 0.0), 1333260095: (0.0, 'Should be the crop_list due to order', 0.0), 1333260011: (0.0, 'Should be the crop_list due to order', 0.0), 1333260000: (0.0, 'Should be the crop_list due to order', 0.0), 1333259996: (0.0, 'Should be the crop_list due to order', 0.0), 1333259830: (0.0, 'Should be the crop_list due to order', 0.0), 1333259822: (0.0, 'Should be the crop_list due to order', 0.0), 1333259741: (0.0, 'Should be the crop_list due to order', 0.0), 1333259634: (0.0, 'Should be the crop_list due to order', 0.0), 1333259603: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1333260105, 1333260095, 1333260011, 1333260000, 1333259996, 1333259830, 1333259822, 1333259741, 1333259634, 1333259603] Looping around the photos to save general results len do output : 10 /1333260105.Didn't retrieve data . /1333260095.Didn't retrieve data . /1333260011.Didn't retrieve data . /1333260000.Didn't retrieve data . /1333259996.Didn't retrieve data . /1333259830.Didn't retrieve data . /1333259822.Didn't retrieve data . /1333259741.Didn't retrieve data . /1333259634.Didn't retrieve data . /1333259603.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260105', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260095', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260011', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260000', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259996', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259830', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259822', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259741', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259634', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259603', None, None, None, None, None, '2533463') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.018785476684570312 save_final save missing photos in datou_result : time spend for datou_step_exec : 372.8859758377075 time spend to save output : 0.0195157527923584 total time spend for step 8 : 372.9054915904999 step9:crop_condition Sat Feb 1 06:49:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4211 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 228 chid ids of type : 4211 begin to crop the class : barquette_opaque param for this class : {'min_score': 0.5} filtre for class : barquette_opaque hashtag_id of this class : 2107760128 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 4869462 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738389006_3520381 we have uploaded 10 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.10791015625 we have finished the crop for the class : barquette_opaque begin to crop the class : carton param for this class : {'min_score': 0.5} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 25 About to insert : list_path_to_insert length 25 new photo from crops ! About to upload 25 photos upload in portfolio : 4869462 init cache_photo without model_param we have 25 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738389017_3520381 we have uploaded 25 photos in the portfolio 4869462 time of upload the photos Elapsed time : 7.041112184524536 we have finished the crop for the class : carton begin to crop the class : ela param for this class : {'min_score': 0.5} filtre for class : ela hashtag_id of this class : 492741797 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 4869462 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738389029_3520381 we have uploaded 8 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.239506244659424 we have finished the crop for the class : ela begin to crop the class : environnement param for this class : {'min_score': 0.5} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738389036_3520381 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.8853530883789062 we have finished the crop for the class : environnement begin to crop the class : etiquette param for this class : {'min_score': 0.5} filtre for class : etiquette hashtag_id of this class : 492636447 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738389040_3520381 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.7576217651367188 we have finished the crop for the class : etiquette begin to crop the class : film_plastique param for this class : {'min_score': 0.5} filtre for class : film_plastique hashtag_id of this class : 2107756122 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 4869462 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738389047_3520381 we have uploaded 10 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.5257859230041504 we have finished the crop for the class : film_plastique begin to crop the class : kraft param for this class : {'min_score': 0.5} filtre for class : kraft hashtag_id of this class : 493202403 begin to crop the class : metal param for this class : {'min_score': 0.5} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738389052_3520381 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.8812496662139893 we have finished the crop for the class : metal begin to crop the class : pehd param for this class : {'min_score': 0.5} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 50 About to insert : list_path_to_insert length 50 new photo from crops ! About to upload 50 photos upload in portfolio : 4869462 init cache_photo without model_param we have 50 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738389384_3520381 we have uploaded 50 photos in the portfolio 4869462 time of upload the photos Elapsed time : 17.60222315788269 we have finished the crop for the class : pehd begin to crop the class : pet_clair param for this class : {'min_score': 0.5} filtre for class : pet_clair hashtag_id of this class : 2107755846 begin to crop the class : pet_opaque param for this class : {'min_score': 0.5} filtre for class : pet_opaque hashtag_id of this class : 2107759152 begin to crop the class : textiles_sanitaires param for this class : {'min_score': 0.5} filtre for class : textiles_sanitaires hashtag_id of this class : 2107760129 begin to crop the class : pet_fonce param for this class : {'min_score': 0.5} filtre for class : pet_fonce hashtag_id of this class : 2107755900 begin to crop the class : papier param for this class : {'min_score': 0.5} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 40 About to insert : list_path_to_insert length 40 new photo from crops ! About to upload 40 photos upload in portfolio : 4869462 init cache_photo without model_param we have 40 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738389413_3520381 we have uploaded 40 photos in the portfolio 4869462 time of upload the photos Elapsed time : 11.57259750366211 we have finished the crop for the class : papier delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1333260105, 1333260095, 1333260011, 1333260000, 1333259996, 1333259830, 1333259822, 1333259741, 1333259634, 1333259603] Looping around the photos to save general results len do output : 149 /1333623962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333623999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333624980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260105', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260095', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260011', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260000', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259996', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259830', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259822', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259741', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259634', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259603', None, None, None, None, None, '2533463') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 457 time used for this insertion : 0.6000738143920898 save_final save missing photos in datou_result : time spend for datou_step_exec : 430.53655219078064 time spend to save output : 0.6035428047180176 total time spend for step 9 : 431.14009499549866 step10:ventilate_hashtags_in_portfolio Sat Feb 1 06:57:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20108234 get user id for portfolio 20108234 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20108234 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('kraft','papier','film_plastique','carton','metal','flou','etiquette','environnement','pet_fonce','ela','pehd','textiles_sanitaires','mal_croppe','pet_clair','barquette_opaque','pet_opaque')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20108234 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('kraft','papier','film_plastique','carton','metal','flou','etiquette','environnement','pet_fonce','ela','pehd','textiles_sanitaires','mal_croppe','pet_clair','barquette_opaque','pet_opaque')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20108234 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('kraft','papier','film_plastique','carton','metal','flou','etiquette','environnement','pet_fonce','ela','pehd','textiles_sanitaires','mal_croppe','pet_clair','barquette_opaque','pet_opaque')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/20136819,20136820,20136821,20136822,20136823,20136824,20136825,20136826,20136827,20136828,20136829,20136830,20136831,20136832,20136833,20136834?tags=kraft,papier,film_plastique,carton,metal,flou,etiquette,environnement,pet_fonce,ela,pehd,textiles_sanitaires,mal_croppe,pet_clair,barquette_opaque,pet_opaque Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1333260105, 1333260095, 1333260011, 1333260000, 1333259996, 1333259830, 1333259822, 1333259741, 1333259634, 1333259603] Looping around the photos to save general results len do output : 1 /20108234. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260105', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260095', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260011', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260000', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259996', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259830', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259822', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259741', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259634', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259603', None, None, None, None, None, '2533463') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.014113903045654297 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.3340139389038086 time spend to save output : 0.017667531967163086 total time spend for step 10 : 1.3516814708709717 step11:final Sat Feb 1 06:57:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1333260105: ('0.04172691062774052',), 1333260095: ('0.04172691062774052',), 1333260011: ('0.04172691062774052',), 1333260000: ('0.04172691062774052',), 1333259996: ('0.04172691062774052',), 1333259830: ('0.04172691062774052',), 1333259822: ('0.04172691062774052',), 1333259741: ('0.04172691062774052',), 1333259634: ('0.04172691062774052',), 1333259603: ('0.04172691062774052',)} new output for save of step final : {1333260105: ('0.04172691062774052',), 1333260095: ('0.04172691062774052',), 1333260011: ('0.04172691062774052',), 1333260000: ('0.04172691062774052',), 1333259996: ('0.04172691062774052',), 1333259830: ('0.04172691062774052',), 1333259822: ('0.04172691062774052',), 1333259741: ('0.04172691062774052',), 1333259634: ('0.04172691062774052',), 1333259603: ('0.04172691062774052',)} [1333260105, 1333260095, 1333260011, 1333260000, 1333259996, 1333259830, 1333259822, 1333259741, 1333259634, 1333259603] Looping around the photos to save general results len do output : 10 /1333260105.Didn't retrieve data . /1333260095.Didn't retrieve data . /1333260011.Didn't retrieve data . /1333260000.Didn't retrieve data . /1333259996.Didn't retrieve data . /1333259830.Didn't retrieve data . /1333259822.Didn't retrieve data . /1333259741.Didn't retrieve data . /1333259634.Didn't retrieve data . /1333259603.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260105', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260095', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260011', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260000', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259996', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259830', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259822', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259741', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259634', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259603', None, None, None, None, None, '2533463') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.022183895111083984 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10097980499267578 time spend to save output : 0.02268671989440918 total time spend for step 11 : 0.12366652488708496 step12:velours_tree Sat Feb 1 06:57:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.0940084457397461 time spend to save output : 3.600120544433594e-05 total time spend for step 12 : 0.09404444694519043 step13:send_mail_cod Sat Feb 1 06:57:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P20108234_01-02-2025_06_57_09.pdf 20136819 imagette201368191738389429 20136820 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201368201738389429 20136821 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201368211738389431 20136822 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201368221738389432 20136823 change filename to text .change filename to text .imagette201368231738389433 20136824 imagette201368241738389433 20136825 change filename to text .change filename to text .imagette201368251738389433 20136827 imagette201368271738389433 20136828 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201368281738389433 20136830 imagette201368301738389434 20136831 imagette201368311738389434 20136832 imagette201368321738389434 20136833 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201368331738389434 20136834 imagette201368341738389435 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20108234 and hashtag_type = 4211 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20136819,20136820,20136821,20136822,20136823,20136824,20136825,20136826,20136827,20136828,20136829,20136830,20136831,20136832,20136833,20136834?tags=kraft,papier,film_plastique,carton,metal,flou,etiquette,environnement,pet_fonce,ela,pehd,textiles_sanitaires,mal_croppe,pet_clair,barquette_opaque,pet_opaque your option no_mail is active, we will not send the real mail to your client args[1333260105] : ((1333260105, -3.4058318428375367, 492609224), (1333260105, -0.8467947641372953, 501862349), '0.04172691062774052') We are sending mail with results at report@fotonower.com args[1333260095] : ((1333260095, -5.2076593921828005, 492609224), (1333260095, -0.04882283341607187, 2107752395), '0.04172691062774052') We are sending mail with results at report@fotonower.com args[1333260011] : ((1333260011, -3.096438503662076, 492609224), (1333260011, -1.46626619346584, 501862349), '0.04172691062774052') We are sending mail with results at report@fotonower.com args[1333260000] : ((1333260000, -5.335492899355421, 492609224), (1333260000, 0.09992706070393223, 2107752395), '0.04172691062774052') We are sending mail with results at report@fotonower.com args[1333259996] : ((1333259996, -5.173635317456816, 492609224), (1333259996, 0.1116099028401584, 2107752395), '0.04172691062774052') We are sending mail with results at report@fotonower.com args[1333259830] : ((1333259830, -5.26182795430222, 492609224), (1333259830, 0.20543387928045778, 2107752395), '0.04172691062774052') We are sending mail with results at report@fotonower.com args[1333259822] : ((1333259822, -5.244588441738222, 492609224), (1333259822, 0.1836502516045019, 2107752395), '0.04172691062774052') We are sending mail with results at report@fotonower.com args[1333259741] : ((1333259741, -3.557791595298561, 492609224), (1333259741, -0.7629320135856643, 501862349), '0.04172691062774052') We are sending mail with results at report@fotonower.com args[1333259634] : ((1333259634, -5.006505313033296, 492609224), (1333259634, -0.009439377891158136, 2107752395), '0.04172691062774052') We are sending mail with results at report@fotonower.com args[1333259603] : ((1333259603, -5.226842078450369, 492609224), (1333259603, 0.28410727229689786, 2107752395), '0.04172691062774052') We are sending mail with results at report@fotonower.com refus_total : 0.04172691062774052 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20108234 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20108234_01-02-2025_06_57_09.pdf results_Auto_P20108234_01-02-2025_06_57_09.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20108234_01-02-2025_06_57_09.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4909','20108234','results_Auto_P20108234_01-02-2025_06_57_09.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20108234_01-02-2025_06_57_09.pdf','pdf','','0.8','0.04172691062774052') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1333260105, 1333260095, 1333260011, 1333260000, 1333259996, 1333259830, 1333259822, 1333259741, 1333259634, 1333259603] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260105', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260095', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260011', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260000', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259996', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259830', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259822', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259741', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259634', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259603', None, None, None, None, None, '2533463') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.023755788803100586 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.360473155975342 time spend to save output : 0.024073123931884766 total time spend for step 13 : 8.384546279907227 step14:split_time_score Sat Feb 1 06:57:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('09', 22),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 31012025 20108234 Nombre de photos uploadées : 22 / 23040 (0%) 31012025 20108234 Nombre de photos taguées (types de déchets): 0 / 22 (0%) 31012025 20108234 Nombre de photos taguées (volume) : 0 / 22 (0%) elapsed_time : load_data_split_time_score 2.6226043701171875e-06 elapsed_time : order_list_meta_photo_and_scores 6.198883056640625e-06 ?????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.001155853271484375 elapsed_time : insert_dashboard_record_day_entry 0.024859189987182617 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.048317269335161735 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20101894_31-01-2025_17_32_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20101894 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20101894 AND mptpi.`type`=4207 To do Qualite : 0.048317269335161735 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20101894_31-01-2025_17_32_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20101894 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20101894 AND mptpi.`type`=4207 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20101919 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20102661 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20102662 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20102663 order by id desc limit 1 Qualite : 0.08902786066502703 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20102664_31-01-2025_07_49_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20102664 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20102664 AND mptpi.`type`=3594 To do Qualite : 0.011035329105844602 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116898_31-01-2025_21_11_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116898 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116898 AND mptpi.`type`=3327 To do Qualite : 0.0532787592474673 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20104699_31-01-2025_09_13_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20104699 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20104699 AND mptpi.`type`=4207 To do Qualite : 0.0532787592474673 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20104699_31-01-2025_09_13_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20104699 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20104699 AND mptpi.`type`=4207 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20104700 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20104703 order by id desc limit 1 Qualite : 0.04450619643594172 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20104704_31-01-2025_09_13_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20104704 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20104704 AND mptpi.`type`=4200 To do Qualite : 0.0389150612957706 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20104705_31-01-2025_09_05_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20104705 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20104705 AND mptpi.`type`=4207 To do Qualite : 0.0389150612957706 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20104705_31-01-2025_09_05_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20104705 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20104705 AND mptpi.`type`=4207 To do Qualite : 0.06518677425271137 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20105987_31-01-2025_10_46_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20105987 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20105987 AND mptpi.`type`=4211 To do Qualite : 0.062131594056886036 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20105988_31-01-2025_09_31_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20105988 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20105988 AND mptpi.`type`=4207 To do Qualite : 0.062131594056886036 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20105988_31-01-2025_09_31_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20105988 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20105988 AND mptpi.`type`=4207 To do Qualite : 0.04592298383232604 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20105989_31-01-2025_09_44_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20105989 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20105989 AND mptpi.`type`=4200 To do Qualite : 0.021323584062132642 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20106006_01-02-2025_06_04_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106006 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20106006 AND mptpi.`type`=3327 To do Qualite : 0.0659760195972663 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20106007_01-02-2025_06_54_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106007 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20106007 AND mptpi.`type`=4211 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116899 order by id desc limit 1 Qualite : 0.07669007200777468 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20108230_31-01-2025_14_04_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108230 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20108230 AND mptpi.`type`=4207 To do Qualite : 0.07669007200777468 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20108230_31-01-2025_14_04_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108230 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20108230 AND mptpi.`type`=4207 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108232 order by id desc limit 1 Qualite : 0.04172691062774052 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20108234_01-02-2025_06_57_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108234 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20108234 AND mptpi.`type`=4211 To do Qualite : 0.039392854453661925 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20108235_31-01-2025_10_21_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108235 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20108235 AND mptpi.`type`=3726 To do Qualite : 0.0476585190222166 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20108236_31-01-2025_13_40_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108236 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20108236 AND mptpi.`type`=4200 To do Qualite : 0.06450243762976816 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20110612_31-01-2025_11_46_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110612 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110612 AND mptpi.`type`=4207 To do Qualite : 0.06450243762976816 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20110612_31-01-2025_11_46_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110612 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110612 AND mptpi.`type`=4207 To do Qualite : 0.049907224850733796 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20110615_31-01-2025_11_35_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110615 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110615 AND mptpi.`type`=4207 To do Qualite : 0.049907224850733796 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20110615_31-01-2025_11_35_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110615 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110615 AND mptpi.`type`=4207 To do Qualite : 0.03257315850760986 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20110617_01-02-2025_05_51_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110617 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110617 AND mptpi.`type`=3327 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110620 order by id desc limit 1 Qualite : 0.04871923513455589 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20110622_31-01-2025_11_54_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110622 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110622 AND mptpi.`type`=4200 To do Qualite : 0.05783960199992943 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116388_31-01-2025_15_28_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116388 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116388 AND mptpi.`type`=4207 To do Qualite : 0.05783960199992943 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116388_31-01-2025_15_28_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116388 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116388 AND mptpi.`type`=4207 To do Qualite : 0.05078932470128937 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20115463_31-01-2025_15_09_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115463 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20115463 AND mptpi.`type`=4211 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113518 order by id desc limit 1 Qualite : 0.046050081756076854 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20113520_31-01-2025_13_19_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113520 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20113520 AND mptpi.`type`=4200 To do Qualite : 0.06408477493466957 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20113522_31-01-2025_13_25_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113522 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20113522 AND mptpi.`type`=4211 To do Qualite : 0.039927772457590216 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20113524_31-01-2025_12_36_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113524 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20113524 AND mptpi.`type`=3726 To do Qualite : 0.061467324636990894 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20113526_31-01-2025_13_02_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113526 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20113526 AND mptpi.`type`=4207 To do Qualite : 0.061467324636990894 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20113526_31-01-2025_13_02_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113526 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20113526 AND mptpi.`type`=4207 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115132 order by id desc limit 1 Qualite : 0.05921587136666769 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20115133_31-01-2025_14_17_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115133 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20115133 AND mptpi.`type`=4200 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115134 order by id desc limit 1 Qualite : 0.08455509921512683 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20115464_31-01-2025_14_08_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115464 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20115464 AND mptpi.`type`=4207 To do Qualite : 0.08455509921512683 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20115464_31-01-2025_14_08_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115464 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20115464 AND mptpi.`type`=4207 To do Qualite : 0.011256581107159599 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20115465_01-02-2025_01_13_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115465 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20115465 AND mptpi.`type`=3327 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115466 order by id desc limit 1 Qualite : 0.07518493725304869 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20115467_31-01-2025_14_03_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115467 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20115467 AND mptpi.`type`=4207 To do Qualite : 0.07518493725304869 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20115467_31-01-2025_14_03_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115467 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20115467 AND mptpi.`type`=4207 To do Qualite : 0.027086503302507146 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116389_31-01-2025_15_07_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116389 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116389 AND mptpi.`type`=3726 To do Qualite : 0.056621078236339516 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116390_31-01-2025_15_25_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116390 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116390 AND mptpi.`type`=4200 To do Qualite : 0.051673272292095285 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116391_31-01-2025_15_20_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116391 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116391 AND mptpi.`type`=4207 To do Qualite : 0.051673272292095285 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116391_31-01-2025_15_20_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116391 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116391 AND mptpi.`type`=4207 To do Qualite : 0.06867978753776505 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116392_31-01-2025_18_36_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116392 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116392 AND mptpi.`type`=4211 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116393 order by id desc limit 1 Qualite : 0.007176973093388443 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116900_31-01-2025_18_35_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116900 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116900 AND mptpi.`type`=3327 To do Qualite : 0.036914927986327575 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116901_31-01-2025_16_06_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116901 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116901 AND mptpi.`type`=4200 To do Qualite : 0.13120195092036752 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116902_31-01-2025_15_25_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116902 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116902 AND mptpi.`type`=3726 To do Qualite : 0.05778384063323714 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116903_31-01-2025_15_25_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116903 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116903 AND mptpi.`type`=4207 To do Qualite : 0.05778384063323714 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116903_31-01-2025_15_25_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116903 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116903 AND mptpi.`type`=4207 To do Qualite : 0.0030112047237664872 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20116904_31-01-2025_17_10_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20116904 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20116904 AND mptpi.`type`=3327 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20117991 order by id desc limit 1 Qualite : 0.05516238847962785 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20117992_31-01-2025_17_04_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20117992 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20117992 AND mptpi.`type`=4207 To do Qualite : 0.05516238847962785 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20117992_31-01-2025_17_04_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20117992 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20117992 AND mptpi.`type`=4207 To do Qualite : 0.05728591369167183 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20117993_31-01-2025_17_02_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20117993 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20117993 AND mptpi.`type`=4200 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20117994 order by id desc limit 1 Qualite : 0.006116510660094263 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20118086_31-01-2025_18_20_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20118086 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20118086 AND mptpi.`type`=3327 To do Qualite : 0.05142021228171343 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20118087_31-01-2025_17_16_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20118087 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20118087 AND mptpi.`type`=4207 To do Qualite : 0.05142021228171343 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20118087_31-01-2025_17_16_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20118087 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20118087 AND mptpi.`type`=4207 To do Qualite : 0.0941318600501543 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20118088_31-01-2025_16_46_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20118088 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20118088 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20118089 order by id desc limit 1 Qualite : 0.054084543034637805 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121224_31-01-2025_22_19_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121224 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121224 AND mptpi.`type`=4211 To do Qualite : 0.05193382931776504 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20119790_31-01-2025_19_45_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119790 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119790 AND mptpi.`type`=4207 To do Qualite : 0.05193382931776504 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20119790_31-01-2025_19_45_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119790 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119790 AND mptpi.`type`=4207 To do Qualite : 0.027673635754115366 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20118800_31-01-2025_18_25_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20118800 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20118800 AND mptpi.`type`=4200 To do Qualite : 0.0028814866957487134 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20118801_31-01-2025_18_46_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20118801 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20118801 AND mptpi.`type`=3327 To do Qualite : 0.055418049072296714 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20118802_31-01-2025_18_33_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20118802 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20118802 AND mptpi.`type`=4211 To do Qualite : 0.0 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20118803_31-01-2025_18_23_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20118803 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20118803 AND mptpi.`type`=3327 To do Qualite : 0.048052208997863916 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20119792_31-01-2025_19_39_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119792 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119792 AND mptpi.`type`=4207 To do Qualite : 0.048052208997863916 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20119792_31-01-2025_19_39_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119792 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119792 AND mptpi.`type`=4207 To do Qualite : 0.04891874515452938 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20119794_31-01-2025_20_02_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119794 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119794 AND mptpi.`type`=4211 To do Qualite : 0.04141813711712598 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20119796_31-01-2025_19_53_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119796 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119796 AND mptpi.`type`=4200 To do Qualite : 0.050931190952783575 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20119798_31-01-2025_19_35_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119798 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119798 AND mptpi.`type`=4207 To do Qualite : 0.050931190952783575 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20119798_31-01-2025_19_35_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119798 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119798 AND mptpi.`type`=4207 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119801 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119803 order by id desc limit 1 Qualite : 0.00288225932534327 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20119805_31-01-2025_22_35_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119805 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119805 AND mptpi.`type`=3327 To do Qualite : 0.033157370448949786 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20119807_31-01-2025_19_57_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119807 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119807 AND mptpi.`type`=4200 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119809 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121227 order by id desc limit 1 Qualite : 0.04118007233146527 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121229_31-01-2025_22_08_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121229 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121229 AND mptpi.`type`=4207 To do Qualite : 0.04118007233146527 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121229_31-01-2025_22_08_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121229 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121229 AND mptpi.`type`=4207 To do Qualite : 0.05619545984030286 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121231_31-01-2025_22_23_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121231 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121231 AND mptpi.`type`=4211 To do Qualite : 0.001276028841739385 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121233_31-01-2025_23_27_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121233 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121233 AND mptpi.`type`=3327 To do Qualite : 0.05823438486612823 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121235_31-01-2025_22_06_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121235 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121235 AND mptpi.`type`=4207 To do Qualite : 0.05823438486612823 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121235_31-01-2025_22_06_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121235 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121235 AND mptpi.`type`=4207 To do Qualite : 0.08835539641203703 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121237_31-01-2025_21_14_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121237 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121237 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121239 order by id desc limit 1 Qualite : 0.07068776229246367 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121241_31-01-2025_22_29_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121241 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121241 AND mptpi.`type`=4200 To do Qualite : 0.06525091354991712 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121243_31-01-2025_21_59_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121243 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121243 AND mptpi.`type`=4207 To do Qualite : 0.06525091354991712 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20121243_31-01-2025_21_59_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121243 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121243 AND mptpi.`type`=4207 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121245 order by id desc limit 1 Qualite : 0.023359382301220474 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20127076_01-02-2025_01_01_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127076 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127076 AND mptpi.`type`=3726 To do Qualite : 0.053315331448418254 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20127077_01-02-2025_00_46_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127077 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127077 AND mptpi.`type`=4207 To do Qualite : 0.053315331448418254 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20127077_01-02-2025_00_46_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127077 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127077 AND mptpi.`type`=4207 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'31012025': {'nb_upload': 22, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1333260105, 1333260095, 1333260011, 1333260000, 1333259996, 1333259830, 1333259822, 1333259741, 1333259634, 1333259603] Looping around the photos to save general results len do output : 1 /20108234Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260105', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260095', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260011', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333260000', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259996', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259830', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259822', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259741', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259634', None, None, None, None, None, '2533463') ('4909', None, None, None, None, None, None, None, '2533463') ('4909', '20108234', '1333259603', None, None, None, None, None, '2533463') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.014333963394165039 save_final save missing photos in datou_result : time spend for datou_step_exec : 24.21666169166565 time spend to save output : 0.01447153091430664 total time spend for step 14 : 24.231133222579956 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 652.88user 447.64system 23:18.42elapsed 78%CPU (0avgtext+0avgdata 8165444maxresident)k 15679056inputs+827848outputs (467231major+37429077minor)pagefaults 0swaps