python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4909 -l 10 ' -s datou_current_4909 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3330313 load datou : 4909 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? id de la photo (peut être local ou global) was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5359, 'Mask_Limeil_Label_PEHD_080621', 16384, 25088, 'Mask_Limeil_Label_PEHD_080621', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 6, 9, 7, 22, 34), datetime.datetime(2021, 6, 9, 7, 22, 34)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5557, 'learn_generique_01122021_6000_v2', 2048, 2048, 'learn_generique_01122021_6000_v2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 1, 19, 59, 17), datetime.datetime(2021, 12, 1, 19, 59, 17)) load thcls load THCL from format json or kwargs add thcl : 2976 in CacheModelConfig load THCL from format json or kwargs add thcl : 3233 in CacheModelConfig load pdts add pdt : 5359 in CacheModelConfig add pdt : 5557 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 20>10 please execute split_portfolio.py -i 19770008 -l 10 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4909, datou_cur_ids : ['2533517'] with mtr_portfolio_ids : ['19770008'] and first list_photo_ids : [] new path : /proc/3330313/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, blur_detection, brightness, crop_condition, thcl, argmax, merge_mask_thcl_custom, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 1.4143803119659424 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 14 step1:mask_detect Sat Feb 1 05:34:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 9802 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-01 05:34:34.022278: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-01 05:34:34.055494: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493020000 Hz 2025-02-01 05:34:34.058638: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7efff8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-01 05:34:34.058710: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-01 05:34:34.065478: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-01 05:34:34.327927: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x15ddc4a0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-01 05:34:34.328000: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-01 05:34:34.330543: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 05:34:34.332635: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 05:34:34.366590: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 05:34:34.383277: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 05:34:34.385584: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 05:34:34.396841: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 05:34:34.401068: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 05:34:34.455154: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 05:34:34.456774: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 05:34:34.457256: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 05:34:34.458344: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 05:34:34.458360: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 05:34:34.458369: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 05:34:34.460120: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9071 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-01 05:34:34.835408: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 05:34:34.835538: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 05:34:34.835558: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 05:34:34.835576: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 05:34:34.835593: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 05:34:34.835611: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 05:34:34.835627: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 05:34:34.835644: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 05:34:34.836886: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 05:34:34.838047: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 05:34:34.838079: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 05:34:34.838094: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 05:34:34.838109: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 05:34:34.838123: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 05:34:34.838137: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 05:34:34.838151: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 05:34:34.838165: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 05:34:34.839308: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 05:34:34.839355: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 05:34:34.839363: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 05:34:34.839371: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 05:34:34.840576: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9071 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2976 thcls : [{'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5359 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5359, 'Mask_Limeil_Label_PEHD_080621', 16384, 25088, 'Mask_Limeil_Label_PEHD_080621', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 6, 9, 7, 22, 34), datetime.datetime(2021, 6, 9, 7, 22, 34)) {'thcl': {'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'environnement', 'fibreux_cont', 'metal_cont', 'pet_clair_cont', 'pet_fonce_cont', 'pet_opaque_cont', 'barquette', 'film_plastique', 'autre_contaminant', 'etiquette_detachee'], 'list_hashtags_csv': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'svm_hashtag_type_desc': 5359, 'photo_desc_type': 5359, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'environnement', 'fibreux_cont', 'metal_cont', 'pet_clair_cont', 'pet_fonce_cont', 'pet_opaque_cont', 'barquette', 'film_plastique', 'autre_contaminant', 'etiquette_detachee'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME Mask_Limeil_Label_PEHD_080621 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : Mask_Limeil_Label_PEHD_080621 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-01 05:34:41.019242: W tensorflow/core/framework/cpu_allocator_impl.cc:81] Allocation of 51380224 exceeds 10% of free system memory. 2025-02-01 05:34:45.248003: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 05:34:45.673388: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/Mask_Limeil_Label_PEHD_080621 /data/models_weight/Mask_Limeil_Label_PEHD_080621/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2021-08-11 19:43:15 create time in s3 : 2021-08-06 17:21:30 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 62 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 69 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 67 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 65 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 65 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 54 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 71 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 74 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 67 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 81 Detection mask done ! Trying to reset tf kernel 3330807 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4513 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9802 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2976 Catched exception ! Connect or reconnect ! thcls : [{'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5359 ['background', 'environnement', 'fibreux_cont', 'metal_cont', 'pet_clair_cont', 'pet_fonce_cont', 'pet_opaque_cont', 'barquette', 'film_plastique', 'autre_contaminant', 'etiquette_detachee'] time for calcul the mask position with numpy : 0.0072002410888671875 nb_pixel_total : 99217 time to create 1 rle with old method : 0.10726451873779297 length of segment : 376 time for calcul the mask position with numpy : 0.006468296051025391 nb_pixel_total : 11494 time to create 1 rle with old method : 0.01672673225402832 length of segment : 129 time for calcul the mask position with numpy : 0.005393028259277344 nb_pixel_total : 86208 time to create 1 rle with old method : 0.09984588623046875 length of segment : 375 time for calcul the mask position with numpy : 0.00040078163146972656 nb_pixel_total : 4907 time to create 1 rle with old method : 0.005913496017456055 length of segment : 94 time for calcul the mask position with numpy : 0.0040514469146728516 nb_pixel_total : 96583 time to create 1 rle with old method : 0.1152498722076416 length of segment : 450 time for calcul the mask position with numpy : 0.005854368209838867 nb_pixel_total : 125359 time to create 1 rle with old method : 0.13955163955688477 length of segment : 372 time for calcul the mask position with numpy : 0.0037729740142822266 nb_pixel_total : 94138 time to create 1 rle with old method : 0.10404539108276367 length of segment : 431 time for calcul the mask position with numpy : 0.0072057247161865234 nb_pixel_total : 143096 time to create 1 rle with old method : 0.17393064498901367 length of segment : 486 time for calcul the mask position with numpy : 0.003136157989501953 nb_pixel_total : 82015 time to create 1 rle with old method : 0.09262990951538086 length of segment : 420 time for calcul the mask position with numpy : 0.0007359981536865234 nb_pixel_total : 8147 time to create 1 rle with old method : 0.010018587112426758 length of segment : 102 time for calcul the mask position with numpy : 0.0003895759582519531 nb_pixel_total : 6661 time to create 1 rle with old method : 0.007935047149658203 length of segment : 92 time for calcul the mask position with numpy : 8.535385131835938e-05 nb_pixel_total : 1000 time to create 1 rle with old method : 0.001272439956665039 length of segment : 45 time for calcul the mask position with numpy : 0.0010638236999511719 nb_pixel_total : 6103 time to create 1 rle with old method : 0.007437944412231445 length of segment : 143 time for calcul the mask position with numpy : 0.0001895427703857422 nb_pixel_total : 1870 time to create 1 rle with old method : 0.0023543834686279297 length of segment : 40 time for calcul the mask position with numpy : 0.0007567405700683594 nb_pixel_total : 14039 time to create 1 rle with old method : 0.016104698181152344 length of segment : 132 time for calcul the mask position with numpy : 0.0011553764343261719 nb_pixel_total : 20127 time to create 1 rle with old method : 0.022927284240722656 length of segment : 182 time for calcul the mask position with numpy : 0.0011641979217529297 nb_pixel_total : 17946 time to create 1 rle with old method : 0.02071404457092285 length of segment : 206 time for calcul the mask position with numpy : 0.0004973411560058594 nb_pixel_total : 8146 time to create 1 rle with old method : 0.009511947631835938 length of segment : 115 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 585 time to create 1 rle with old method : 0.0007984638214111328 length of segment : 19 time for calcul the mask position with numpy : 0.00047278404235839844 nb_pixel_total : 11897 time to create 1 rle with old method : 0.015503168106079102 length of segment : 133 time for calcul the mask position with numpy : 0.0011463165283203125 nb_pixel_total : 25589 time to create 1 rle with old method : 0.030260324478149414 length of segment : 202 time for calcul the mask position with numpy : 0.00039696693420410156 nb_pixel_total : 3478 time to create 1 rle with old method : 0.0042345523834228516 length of segment : 126 time for calcul the mask position with numpy : 0.0004813671112060547 nb_pixel_total : 6966 time to create 1 rle with old method : 0.011072158813476562 length of segment : 101 time for calcul the mask position with numpy : 0.0007524490356445312 nb_pixel_total : 28287 time to create 1 rle with old method : 0.0320124626159668 length of segment : 225 time for calcul the mask position with numpy : 0.00030422210693359375 nb_pixel_total : 3737 time to create 1 rle with old method : 0.004469871520996094 length of segment : 80 time for calcul the mask position with numpy : 0.00021839141845703125 nb_pixel_total : 6079 time to create 1 rle with old method : 0.007439136505126953 length of segment : 83 time for calcul the mask position with numpy : 0.0012242794036865234 nb_pixel_total : 13964 time to create 1 rle with old method : 0.018007993698120117 length of segment : 164 time for calcul the mask position with numpy : 0.00040030479431152344 nb_pixel_total : 3242 time to create 1 rle with old method : 0.003912687301635742 length of segment : 97 time for calcul the mask position with numpy : 0.0009918212890625 nb_pixel_total : 15636 time to create 1 rle with old method : 0.017879247665405273 length of segment : 163 time for calcul the mask position with numpy : 0.004553318023681641 nb_pixel_total : 111783 time to create 1 rle with old method : 0.12179398536682129 length of segment : 386 time for calcul the mask position with numpy : 0.0033028125762939453 nb_pixel_total : 65582 time to create 1 rle with old method : 0.0724020004272461 length of segment : 341 time for calcul the mask position with numpy : 0.003547191619873047 nb_pixel_total : 86351 time to create 1 rle with old method : 0.10675621032714844 length of segment : 386 time for calcul the mask position with numpy : 0.005647897720336914 nb_pixel_total : 124892 time to create 1 rle with old method : 0.14568471908569336 length of segment : 436 time for calcul the mask position with numpy : 0.0002281665802001953 nb_pixel_total : 5063 time to create 1 rle with old method : 0.005989551544189453 length of segment : 86 time for calcul the mask position with numpy : 0.004334926605224609 nb_pixel_total : 114726 time to create 1 rle with old method : 0.12534427642822266 length of segment : 510 time for calcul the mask position with numpy : 0.003469228744506836 nb_pixel_total : 50044 time to create 1 rle with old method : 0.06041836738586426 length of segment : 337 time for calcul the mask position with numpy : 0.0008673667907714844 nb_pixel_total : 9981 time to create 1 rle with old method : 0.016989946365356445 length of segment : 156 time for calcul the mask position with numpy : 0.0011341571807861328 nb_pixel_total : 15971 time to create 1 rle with old method : 0.019141435623168945 length of segment : 188 time for calcul the mask position with numpy : 0.00043773651123046875 nb_pixel_total : 5816 time to create 1 rle with old method : 0.007440805435180664 length of segment : 81 time for calcul the mask position with numpy : 0.0010440349578857422 nb_pixel_total : 13163 time to create 1 rle with old method : 0.015537023544311523 length of segment : 143 time for calcul the mask position with numpy : 0.00054931640625 nb_pixel_total : 9617 time to create 1 rle with old method : 0.011806249618530273 length of segment : 77 time for calcul the mask position with numpy : 0.00028896331787109375 nb_pixel_total : 5209 time to create 1 rle with old method : 0.006378650665283203 length of segment : 111 time for calcul the mask position with numpy : 0.00046133995056152344 nb_pixel_total : 3651 time to create 1 rle with old method : 0.004671335220336914 length of segment : 105 time for calcul the mask position with numpy : 0.000705718994140625 nb_pixel_total : 12355 time to create 1 rle with old method : 0.014303922653198242 length of segment : 167 time for calcul the mask position with numpy : 9.942054748535156e-05 nb_pixel_total : 1454 time to create 1 rle with old method : 0.0018296241760253906 length of segment : 43 time for calcul the mask position with numpy : 0.0008418560028076172 nb_pixel_total : 9178 time to create 1 rle with old method : 0.011105060577392578 length of segment : 111 time for calcul the mask position with numpy : 0.0012323856353759766 nb_pixel_total : 21908 time to create 1 rle with old method : 0.027057170867919922 length of segment : 144 time for calcul the mask position with numpy : 0.0009310245513916016 nb_pixel_total : 11988 time to create 1 rle with old method : 0.01405954360961914 length of segment : 156 time for calcul the mask position with numpy : 0.00021886825561523438 nb_pixel_total : 3116 time to create 1 rle with old method : 0.0038805007934570312 length of segment : 55 time for calcul the mask position with numpy : 0.0002231597900390625 nb_pixel_total : 6491 time to create 1 rle with old method : 0.00769352912902832 length of segment : 147 time for calcul the mask position with numpy : 0.0008847713470458984 nb_pixel_total : 18630 time to create 1 rle with old method : 0.02249765396118164 length of segment : 193 time for calcul the mask position with numpy : 0.0005102157592773438 nb_pixel_total : 6305 time to create 1 rle with old method : 0.008357763290405273 length of segment : 161 time for calcul the mask position with numpy : 0.0007390975952148438 nb_pixel_total : 11475 time to create 1 rle with old method : 0.013386249542236328 length of segment : 139 time for calcul the mask position with numpy : 0.003008604049682617 nb_pixel_total : 81908 time to create 1 rle with old method : 0.11579346656799316 length of segment : 546 time for calcul the mask position with numpy : 0.0007474422454833984 nb_pixel_total : 7708 time to create 1 rle with old method : 0.00928497314453125 length of segment : 144 time for calcul the mask position with numpy : 0.0006117820739746094 nb_pixel_total : 9706 time to create 1 rle with old method : 0.011593341827392578 length of segment : 127 time for calcul the mask position with numpy : 0.0003504753112792969 nb_pixel_total : 8709 time to create 1 rle with old method : 0.010524272918701172 length of segment : 105 time for calcul the mask position with numpy : 0.0006213188171386719 nb_pixel_total : 9120 time to create 1 rle with old method : 0.010793447494506836 length of segment : 118 time for calcul the mask position with numpy : 0.0008480548858642578 nb_pixel_total : 16421 time to create 1 rle with old method : 0.019249677658081055 length of segment : 198 time for calcul the mask position with numpy : 0.0005095005035400391 nb_pixel_total : 3557 time to create 1 rle with old method : 0.00434565544128418 length of segment : 116 time for calcul the mask position with numpy : 0.00032639503479003906 nb_pixel_total : 3599 time to create 1 rle with old method : 0.0046274662017822266 length of segment : 59 time for calcul the mask position with numpy : 0.0003046989440917969 nb_pixel_total : 4497 time to create 1 rle with old method : 0.00561213493347168 length of segment : 62 time for calcul the mask position with numpy : 0.0038650035858154297 nb_pixel_total : 80980 time to create 1 rle with old method : 0.08968353271484375 length of segment : 386 time for calcul the mask position with numpy : 0.003911495208740234 nb_pixel_total : 86708 time to create 1 rle with old method : 0.0981438159942627 length of segment : 342 time for calcul the mask position with numpy : 0.004454135894775391 nb_pixel_total : 99194 time to create 1 rle with old method : 0.10969996452331543 length of segment : 373 time for calcul the mask position with numpy : 0.0009226799011230469 nb_pixel_total : 11092 time to create 1 rle with old method : 0.021492719650268555 length of segment : 134 time for calcul the mask position with numpy : 0.000614166259765625 nb_pixel_total : 6302 time to create 1 rle with old method : 0.007231950759887695 length of segment : 148 time for calcul the mask position with numpy : 0.00432896614074707 nb_pixel_total : 106225 time to create 1 rle with old method : 0.11757230758666992 length of segment : 475 time for calcul the mask position with numpy : 0.003656148910522461 nb_pixel_total : 132213 time to create 1 rle with old method : 0.14628815650939941 length of segment : 504 time for calcul the mask position with numpy : 0.0002110004425048828 nb_pixel_total : 2784 time to create 1 rle with old method : 0.003375530242919922 length of segment : 75 time for calcul the mask position with numpy : 0.00018858909606933594 nb_pixel_total : 1234 time to create 1 rle with old method : 0.0015883445739746094 length of segment : 46 time for calcul the mask position with numpy : 0.00023889541625976562 nb_pixel_total : 2291 time to create 1 rle with old method : 0.0029401779174804688 length of segment : 55 time for calcul the mask position with numpy : 0.0014874935150146484 nb_pixel_total : 27316 time to create 1 rle with old method : 0.0310821533203125 length of segment : 242 time for calcul the mask position with numpy : 0.0003101825714111328 nb_pixel_total : 7860 time to create 1 rle with old method : 0.00918889045715332 length of segment : 110 time for calcul the mask position with numpy : 0.00110626220703125 nb_pixel_total : 26032 time to create 1 rle with old method : 0.02964329719543457 length of segment : 184 time for calcul the mask position with numpy : 0.0032181739807128906 nb_pixel_total : 82813 time to create 1 rle with old method : 0.09602189064025879 length of segment : 450 time for calcul the mask position with numpy : 0.00045752525329589844 nb_pixel_total : 7734 time to create 1 rle with old method : 0.009035587310791016 length of segment : 121 time for calcul the mask position with numpy : 0.0010421276092529297 nb_pixel_total : 15223 time to create 1 rle with old method : 0.017989397048950195 length of segment : 174 time for calcul the mask position with numpy : 0.0015187263488769531 nb_pixel_total : 29515 time to create 1 rle with old method : 0.033277034759521484 length of segment : 195 time for calcul the mask position with numpy : 0.00010466575622558594 nb_pixel_total : 718 time to create 1 rle with old method : 0.0008900165557861328 length of segment : 42 time for calcul the mask position with numpy : 0.00038170814514160156 nb_pixel_total : 5428 time to create 1 rle with old method : 0.0060882568359375 length of segment : 98 time for calcul the mask position with numpy : 0.00013780593872070312 nb_pixel_total : 956 time to create 1 rle with old method : 0.0011320114135742188 length of segment : 35 time for calcul the mask position with numpy : 0.00026035308837890625 nb_pixel_total : 5256 time to create 1 rle with old method : 0.006132841110229492 length of segment : 55 time for calcul the mask position with numpy : 0.00014495849609375 nb_pixel_total : 2921 time to create 1 rle with old method : 0.0034389495849609375 length of segment : 79 time for calcul the mask position with numpy : 0.0003299713134765625 nb_pixel_total : 6222 time to create 1 rle with old method : 0.0072479248046875 length of segment : 84 time for calcul the mask position with numpy : 0.0004067420959472656 nb_pixel_total : 5840 time to create 1 rle with old method : 0.006631612777709961 length of segment : 110 time for calcul the mask position with numpy : 0.0004360675811767578 nb_pixel_total : 7063 time to create 1 rle with old method : 0.008214235305786133 length of segment : 94 time for calcul the mask position with numpy : 0.0011334419250488281 nb_pixel_total : 21381 time to create 1 rle with old method : 0.024074554443359375 length of segment : 181 time for calcul the mask position with numpy : 0.0005023479461669922 nb_pixel_total : 10341 time to create 1 rle with old method : 0.01184701919555664 length of segment : 140 time for calcul the mask position with numpy : 0.00014138221740722656 nb_pixel_total : 2526 time to create 1 rle with old method : 0.002992391586303711 length of segment : 92 time for calcul the mask position with numpy : 0.0003376007080078125 nb_pixel_total : 5820 time to create 1 rle with old method : 0.007014036178588867 length of segment : 119 time for calcul the mask position with numpy : 0.0013463497161865234 nb_pixel_total : 23621 time to create 1 rle with old method : 0.026591062545776367 length of segment : 227 time for calcul the mask position with numpy : 0.0005640983581542969 nb_pixel_total : 8728 time to create 1 rle with old method : 0.010288238525390625 length of segment : 119 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 564 time to create 1 rle with old method : 0.0007300376892089844 length of segment : 34 time for calcul the mask position with numpy : 0.00014281272888183594 nb_pixel_total : 3725 time to create 1 rle with old method : 0.00433659553527832 length of segment : 107 time for calcul the mask position with numpy : 0.0009434223175048828 nb_pixel_total : 19160 time to create 1 rle with old method : 0.022144556045532227 length of segment : 128 time for calcul the mask position with numpy : 0.004203081130981445 nb_pixel_total : 114810 time to create 1 rle with old method : 0.12699103355407715 length of segment : 349 time for calcul the mask position with numpy : 0.004618167877197266 nb_pixel_total : 112153 time to create 1 rle with old method : 0.12300944328308105 length of segment : 425 time for calcul the mask position with numpy : 0.00474858283996582 nb_pixel_total : 96113 time to create 1 rle with old method : 0.13284039497375488 length of segment : 422 time for calcul the mask position with numpy : 0.000507354736328125 nb_pixel_total : 4839 time to create 1 rle with old method : 0.0058519840240478516 length of segment : 60 time for calcul the mask position with numpy : 0.0006091594696044922 nb_pixel_total : 8444 time to create 1 rle with old method : 0.009835958480834961 length of segment : 128 time for calcul the mask position with numpy : 0.0005924701690673828 nb_pixel_total : 5967 time to create 1 rle with old method : 0.0073964595794677734 length of segment : 101 time for calcul the mask position with numpy : 0.0005521774291992188 nb_pixel_total : 10169 time to create 1 rle with old method : 0.011714696884155273 length of segment : 147 time for calcul the mask position with numpy : 0.0006716251373291016 nb_pixel_total : 6284 time to create 1 rle with old method : 0.007530689239501953 length of segment : 148 time for calcul the mask position with numpy : 0.00031685829162597656 nb_pixel_total : 3886 time to create 1 rle with old method : 0.00676417350769043 length of segment : 47 time for calcul the mask position with numpy : 0.005812644958496094 nb_pixel_total : 137048 time to create 1 rle with old method : 0.1922304630279541 length of segment : 493 time for calcul the mask position with numpy : 0.00018215179443359375 nb_pixel_total : 3212 time to create 1 rle with old method : 0.0043182373046875 length of segment : 68 time for calcul the mask position with numpy : 0.00042819976806640625 nb_pixel_total : 4252 time to create 1 rle with old method : 0.005895376205444336 length of segment : 92 time for calcul the mask position with numpy : 0.0009050369262695312 nb_pixel_total : 18323 time to create 1 rle with old method : 0.02389669418334961 length of segment : 120 time for calcul the mask position with numpy : 0.0003807544708251953 nb_pixel_total : 6961 time to create 1 rle with old method : 0.00940251350402832 length of segment : 56 time for calcul the mask position with numpy : 0.00043702125549316406 nb_pixel_total : 6597 time to create 1 rle with old method : 0.009298086166381836 length of segment : 99 time for calcul the mask position with numpy : 0.0003368854522705078 nb_pixel_total : 6599 time to create 1 rle with old method : 0.007837533950805664 length of segment : 103 time for calcul the mask position with numpy : 0.003656148910522461 nb_pixel_total : 80707 time to create 1 rle with old method : 0.0912020206451416 length of segment : 448 time for calcul the mask position with numpy : 0.00016379356384277344 nb_pixel_total : 1250 time to create 1 rle with old method : 0.0016353130340576172 length of segment : 38 time for calcul the mask position with numpy : 0.0025663375854492188 nb_pixel_total : 74254 time to create 1 rle with old method : 0.08597612380981445 length of segment : 391 time for calcul the mask position with numpy : 0.0004069805145263672 nb_pixel_total : 4221 time to create 1 rle with old method : 0.005213260650634766 length of segment : 118 time for calcul the mask position with numpy : 0.0010232925415039062 nb_pixel_total : 19271 time to create 1 rle with old method : 0.022456645965576172 length of segment : 210 time for calcul the mask position with numpy : 0.0008742809295654297 nb_pixel_total : 21151 time to create 1 rle with old method : 0.02452874183654785 length of segment : 216 time for calcul the mask position with numpy : 0.0002009868621826172 nb_pixel_total : 4583 time to create 1 rle with old method : 0.005541086196899414 length of segment : 118 time for calcul the mask position with numpy : 9.751319885253906e-05 nb_pixel_total : 743 time to create 1 rle with old method : 0.0011162757873535156 length of segment : 35 time for calcul the mask position with numpy : 0.00035691261291503906 nb_pixel_total : 5949 time to create 1 rle with old method : 0.0068988800048828125 length of segment : 128 time for calcul the mask position with numpy : 0.0002617835998535156 nb_pixel_total : 3011 time to create 1 rle with old method : 0.003657817840576172 length of segment : 91 time for calcul the mask position with numpy : 0.0005025863647460938 nb_pixel_total : 6314 time to create 1 rle with old method : 0.007774829864501953 length of segment : 76 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 486 time to create 1 rle with old method : 0.0006372928619384766 length of segment : 29 time for calcul the mask position with numpy : 0.0006926059722900391 nb_pixel_total : 14448 time to create 1 rle with old method : 0.017467498779296875 length of segment : 163 time for calcul the mask position with numpy : 0.0002830028533935547 nb_pixel_total : 3942 time to create 1 rle with old method : 0.0048520565032958984 length of segment : 69 time for calcul the mask position with numpy : 0.0022504329681396484 nb_pixel_total : 53803 time to create 1 rle with old method : 0.0606386661529541 length of segment : 247 time for calcul the mask position with numpy : 0.0004975795745849609 nb_pixel_total : 6155 time to create 1 rle with old method : 0.007441282272338867 length of segment : 114 time for calcul the mask position with numpy : 0.0004432201385498047 nb_pixel_total : 8735 time to create 1 rle with old method : 0.010787010192871094 length of segment : 128 time for calcul the mask position with numpy : 0.0005192756652832031 nb_pixel_total : 6822 time to create 1 rle with old method : 0.008652210235595703 length of segment : 124 time for calcul the mask position with numpy : 0.000324249267578125 nb_pixel_total : 8350 time to create 1 rle with old method : 0.010144472122192383 length of segment : 124 time for calcul the mask position with numpy : 0.005033731460571289 nb_pixel_total : 100028 time to create 1 rle with old method : 0.11319398880004883 length of segment : 471 time for calcul the mask position with numpy : 0.004665851593017578 nb_pixel_total : 103347 time to create 1 rle with old method : 0.11467719078063965 length of segment : 420 time for calcul the mask position with numpy : 0.0007619857788085938 nb_pixel_total : 14328 time to create 1 rle with old method : 0.016536951065063477 length of segment : 139 time for calcul the mask position with numpy : 0.003415822982788086 nb_pixel_total : 80059 time to create 1 rle with old method : 0.09136509895324707 length of segment : 377 time for calcul the mask position with numpy : 0.0010230541229248047 nb_pixel_total : 20840 time to create 1 rle with old method : 0.0254976749420166 length of segment : 142 time for calcul the mask position with numpy : 0.003634929656982422 nb_pixel_total : 101237 time to create 1 rle with old method : 0.11297798156738281 length of segment : 487 time for calcul the mask position with numpy : 0.0011737346649169922 nb_pixel_total : 21001 time to create 1 rle with old method : 0.023919105529785156 length of segment : 173 time for calcul the mask position with numpy : 0.0003170967102050781 nb_pixel_total : 5048 time to create 1 rle with old method : 0.0063381195068359375 length of segment : 74 time for calcul the mask position with numpy : 0.0003063678741455078 nb_pixel_total : 2885 time to create 1 rle with old method : 0.003643512725830078 length of segment : 62 time for calcul the mask position with numpy : 0.0008122920989990234 nb_pixel_total : 13411 time to create 1 rle with old method : 0.015670061111450195 length of segment : 143 time for calcul the mask position with numpy : 0.0002474784851074219 nb_pixel_total : 3051 time to create 1 rle with old method : 0.003935575485229492 length of segment : 49 time for calcul the mask position with numpy : 0.00028014183044433594 nb_pixel_total : 5971 time to create 1 rle with old method : 0.007013559341430664 length of segment : 130 time for calcul the mask position with numpy : 0.0007395744323730469 nb_pixel_total : 13052 time to create 1 rle with old method : 0.018758058547973633 length of segment : 141 time for calcul the mask position with numpy : 0.00038051605224609375 nb_pixel_total : 3269 time to create 1 rle with old method : 0.00396418571472168 length of segment : 89 time for calcul the mask position with numpy : 0.0007662773132324219 nb_pixel_total : 12943 time to create 1 rle with old method : 0.014953374862670898 length of segment : 126 time for calcul the mask position with numpy : 0.0003991127014160156 nb_pixel_total : 4646 time to create 1 rle with old method : 0.00574183464050293 length of segment : 75 time for calcul the mask position with numpy : 0.00035881996154785156 nb_pixel_total : 7065 time to create 1 rle with old method : 0.009299278259277344 length of segment : 83 time for calcul the mask position with numpy : 0.00031304359436035156 nb_pixel_total : 9504 time to create 1 rle with old method : 0.01083993911743164 length of segment : 154 time for calcul the mask position with numpy : 0.0003228187561035156 nb_pixel_total : 5047 time to create 1 rle with old method : 0.006891489028930664 length of segment : 96 time for calcul the mask position with numpy : 0.0014581680297851562 nb_pixel_total : 19113 time to create 1 rle with old method : 0.02405571937561035 length of segment : 304 time for calcul the mask position with numpy : 0.00098419189453125 nb_pixel_total : 5241 time to create 1 rle with old method : 0.006325244903564453 length of segment : 112 time for calcul the mask position with numpy : 0.0006227493286132812 nb_pixel_total : 12161 time to create 1 rle with old method : 0.013795614242553711 length of segment : 102 time for calcul the mask position with numpy : 0.0026476383209228516 nb_pixel_total : 63170 time to create 1 rle with old method : 0.06691408157348633 length of segment : 598 time for calcul the mask position with numpy : 0.00040268898010253906 nb_pixel_total : 7252 time to create 1 rle with old method : 0.008458375930786133 length of segment : 113 time for calcul the mask position with numpy : 0.0004603862762451172 nb_pixel_total : 14181 time to create 1 rle with old method : 0.01591038703918457 length of segment : 178 time for calcul the mask position with numpy : 0.0010037422180175781 nb_pixel_total : 15320 time to create 1 rle with old method : 0.01716923713684082 length of segment : 155 time for calcul the mask position with numpy : 0.0005762577056884766 nb_pixel_total : 10395 time to create 1 rle with old method : 0.011542320251464844 length of segment : 153 time for calcul the mask position with numpy : 0.003175497055053711 nb_pixel_total : 72458 time to create 1 rle with old method : 0.08016180992126465 length of segment : 321 time for calcul the mask position with numpy : 0.0037000179290771484 nb_pixel_total : 96870 time to create 1 rle with old method : 0.10752749443054199 length of segment : 493 time for calcul the mask position with numpy : 0.0007939338684082031 nb_pixel_total : 14835 time to create 1 rle with old method : 0.016660213470458984 length of segment : 146 time for calcul the mask position with numpy : 0.0009906291961669922 nb_pixel_total : 19086 time to create 1 rle with old method : 0.021164655685424805 length of segment : 181 time for calcul the mask position with numpy : 0.003271818161010742 nb_pixel_total : 101906 time to create 1 rle with old method : 0.10920310020446777 length of segment : 458 time for calcul the mask position with numpy : 0.0027344226837158203 nb_pixel_total : 67221 time to create 1 rle with old method : 0.07388806343078613 length of segment : 415 time for calcul the mask position with numpy : 0.0005004405975341797 nb_pixel_total : 6495 time to create 1 rle with old method : 0.007600545883178711 length of segment : 114 time for calcul the mask position with numpy : 0.002774953842163086 nb_pixel_total : 75862 time to create 1 rle with old method : 0.08474326133728027 length of segment : 343 time for calcul the mask position with numpy : 0.0012094974517822266 nb_pixel_total : 26141 time to create 1 rle with old method : 0.029528141021728516 length of segment : 197 time for calcul the mask position with numpy : 0.00028252601623535156 nb_pixel_total : 5735 time to create 1 rle with old method : 0.006808042526245117 length of segment : 95 time for calcul the mask position with numpy : 0.0006778240203857422 nb_pixel_total : 7502 time to create 1 rle with old method : 0.008674860000610352 length of segment : 138 time for calcul the mask position with numpy : 0.000621795654296875 nb_pixel_total : 8318 time to create 1 rle with old method : 0.009535074234008789 length of segment : 195 time for calcul the mask position with numpy : 0.0002288818359375 nb_pixel_total : 3057 time to create 1 rle with old method : 0.003640890121459961 length of segment : 67 time for calcul the mask position with numpy : 0.00038933753967285156 nb_pixel_total : 7978 time to create 1 rle with old method : 0.009846687316894531 length of segment : 60 time for calcul the mask position with numpy : 0.00012731552124023438 nb_pixel_total : 559 time to create 1 rle with old method : 0.0007433891296386719 length of segment : 31 time for calcul the mask position with numpy : 0.0004923343658447266 nb_pixel_total : 10196 time to create 1 rle with old method : 0.01168370246887207 length of segment : 153 time for calcul the mask position with numpy : 0.0003376007080078125 nb_pixel_total : 5942 time to create 1 rle with old method : 0.00689244270324707 length of segment : 99 time for calcul the mask position with numpy : 0.0007565021514892578 nb_pixel_total : 11837 time to create 1 rle with old method : 0.013800382614135742 length of segment : 116 time for calcul the mask position with numpy : 0.0002899169921875 nb_pixel_total : 4320 time to create 1 rle with old method : 0.005356550216674805 length of segment : 93 time for calcul the mask position with numpy : 0.0005512237548828125 nb_pixel_total : 8369 time to create 1 rle with old method : 0.009878396987915039 length of segment : 97 time for calcul the mask position with numpy : 0.00078582763671875 nb_pixel_total : 18665 time to create 1 rle with old method : 0.021268129348754883 length of segment : 149 time for calcul the mask position with numpy : 0.0003998279571533203 nb_pixel_total : 4916 time to create 1 rle with old method : 0.007410526275634766 length of segment : 71 time for calcul the mask position with numpy : 0.0001399517059326172 nb_pixel_total : 1982 time to create 1 rle with old method : 0.002518177032470703 length of segment : 45 time for calcul the mask position with numpy : 0.0003809928894042969 nb_pixel_total : 6767 time to create 1 rle with old method : 0.007839679718017578 length of segment : 82 time for calcul the mask position with numpy : 0.0017833709716796875 nb_pixel_total : 63411 time to create 1 rle with old method : 0.07068300247192383 length of segment : 448 time for calcul the mask position with numpy : 0.0004780292510986328 nb_pixel_total : 9489 time to create 1 rle with old method : 0.013686418533325195 length of segment : 91 time for calcul the mask position with numpy : 0.00043702125549316406 nb_pixel_total : 3960 time to create 1 rle with old method : 0.0053899288177490234 length of segment : 146 time for calcul the mask position with numpy : 0.0002079010009765625 nb_pixel_total : 1284 time to create 1 rle with old method : 0.001987457275390625 length of segment : 63 time for calcul the mask position with numpy : 0.0005230903625488281 nb_pixel_total : 12252 time to create 1 rle with old method : 0.015261173248291016 length of segment : 81 time for calcul the mask position with numpy : 0.0002548694610595703 nb_pixel_total : 3839 time to create 1 rle with old method : 0.004747152328491211 length of segment : 71 time for calcul the mask position with numpy : 0.0004394054412841797 nb_pixel_total : 6377 time to create 1 rle with old method : 0.007648468017578125 length of segment : 81 time for calcul the mask position with numpy : 0.004344940185546875 nb_pixel_total : 83171 time to create 1 rle with old method : 0.09333229064941406 length of segment : 370 time for calcul the mask position with numpy : 0.0036039352416992188 nb_pixel_total : 88118 time to create 1 rle with old method : 0.0970001220703125 length of segment : 352 time for calcul the mask position with numpy : 0.0009088516235351562 nb_pixel_total : 14965 time to create 1 rle with old method : 0.017297029495239258 length of segment : 133 time for calcul the mask position with numpy : 0.005588054656982422 nb_pixel_total : 126361 time to create 1 rle with old method : 0.13864398002624512 length of segment : 429 time for calcul the mask position with numpy : 0.0037126541137695312 nb_pixel_total : 92756 time to create 1 rle with old method : 0.10212421417236328 length of segment : 393 time for calcul the mask position with numpy : 0.0008482933044433594 nb_pixel_total : 7152 time to create 1 rle with old method : 0.012611150741577148 length of segment : 156 time for calcul the mask position with numpy : 0.0054473876953125 nb_pixel_total : 98271 time to create 1 rle with old method : 0.11353421211242676 length of segment : 453 time for calcul the mask position with numpy : 0.0009627342224121094 nb_pixel_total : 13231 time to create 1 rle with old method : 0.01600813865661621 length of segment : 154 time for calcul the mask position with numpy : 0.0003516674041748047 nb_pixel_total : 6924 time to create 1 rle with old method : 0.007923364639282227 length of segment : 165 time for calcul the mask position with numpy : 0.0006840229034423828 nb_pixel_total : 7577 time to create 1 rle with old method : 0.00920724868774414 length of segment : 114 time for calcul the mask position with numpy : 0.00014352798461914062 nb_pixel_total : 410 time to create 1 rle with old method : 0.0005626678466796875 length of segment : 26 time for calcul the mask position with numpy : 0.00017452239990234375 nb_pixel_total : 1234 time to create 1 rle with old method : 0.0015866756439208984 length of segment : 47 time for calcul the mask position with numpy : 0.0007355213165283203 nb_pixel_total : 7226 time to create 1 rle with old method : 0.012583494186401367 length of segment : 112 time for calcul the mask position with numpy : 0.0011305809020996094 nb_pixel_total : 14907 time to create 1 rle with old method : 0.024870634078979492 length of segment : 193 time for calcul the mask position with numpy : 0.0006337165832519531 nb_pixel_total : 9202 time to create 1 rle with old method : 0.011388540267944336 length of segment : 108 time for calcul the mask position with numpy : 0.00044798851013183594 nb_pixel_total : 7521 time to create 1 rle with old method : 0.008779048919677734 length of segment : 113 time for calcul the mask position with numpy : 0.00312042236328125 nb_pixel_total : 71901 time to create 1 rle with old method : 0.10856294631958008 length of segment : 444 time for calcul the mask position with numpy : 0.0007622241973876953 nb_pixel_total : 10873 time to create 1 rle with old method : 0.012504339218139648 length of segment : 129 time for calcul the mask position with numpy : 0.001424551010131836 nb_pixel_total : 22927 time to create 1 rle with old method : 0.025786876678466797 length of segment : 237 time for calcul the mask position with numpy : 0.00015401840209960938 nb_pixel_total : 1024 time to create 1 rle with old method : 0.0013141632080078125 length of segment : 39 time for calcul the mask position with numpy : 0.0003542900085449219 nb_pixel_total : 4584 time to create 1 rle with old method : 0.005576372146606445 length of segment : 67 time for calcul the mask position with numpy : 0.0012822151184082031 nb_pixel_total : 25824 time to create 1 rle with old method : 0.03013324737548828 length of segment : 200 time for calcul the mask position with numpy : 0.001214742660522461 nb_pixel_total : 22217 time to create 1 rle with old method : 0.02547144889831543 length of segment : 174 time for calcul the mask position with numpy : 0.00010800361633300781 nb_pixel_total : 472 time to create 1 rle with old method : 0.0006561279296875 length of segment : 25 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 523 time to create 1 rle with old method : 0.0007078647613525391 length of segment : 20 time for calcul the mask position with numpy : 0.0003592967987060547 nb_pixel_total : 4459 time to create 1 rle with old method : 0.0054132938385009766 length of segment : 71 time for calcul the mask position with numpy : 0.00015425682067871094 nb_pixel_total : 913 time to create 1 rle with old method : 0.0011441707611083984 length of segment : 40 time for calcul the mask position with numpy : 0.0005860328674316406 nb_pixel_total : 8866 time to create 1 rle with old method : 0.01007533073425293 length of segment : 185 time for calcul the mask position with numpy : 9.870529174804688e-05 nb_pixel_total : 1041 time to create 1 rle with old method : 0.0013332366943359375 length of segment : 30 time for calcul the mask position with numpy : 0.00016045570373535156 nb_pixel_total : 4397 time to create 1 rle with old method : 0.0052793025970458984 length of segment : 70 time for calcul the mask position with numpy : 0.00015592575073242188 nb_pixel_total : 4022 time to create 1 rle with old method : 0.004815816879272461 length of segment : 79 time for calcul the mask position with numpy : 0.00016617774963378906 nb_pixel_total : 1014 time to create 1 rle with old method : 0.0013091564178466797 length of segment : 40 time for calcul the mask position with numpy : 0.0005869865417480469 nb_pixel_total : 10891 time to create 1 rle with old method : 0.012583255767822266 length of segment : 176 time for calcul the mask position with numpy : 0.00019049644470214844 nb_pixel_total : 2240 time to create 1 rle with old method : 0.0027365684509277344 length of segment : 87 time for calcul the mask position with numpy : 0.0001983642578125 nb_pixel_total : 1759 time to create 1 rle with old method : 0.002128124237060547 length of segment : 87 time for calcul the mask position with numpy : 0.0026636123657226562 nb_pixel_total : 38496 time to create 1 rle with old method : 0.04324221611022949 length of segment : 352 time for calcul the mask position with numpy : 0.004736661911010742 nb_pixel_total : 85335 time to create 1 rle with old method : 0.09444165229797363 length of segment : 447 time for calcul the mask position with numpy : 0.0019948482513427734 nb_pixel_total : 28270 time to create 1 rle with old method : 0.033233642578125 length of segment : 262 time for calcul the mask position with numpy : 0.004380226135253906 nb_pixel_total : 76813 time to create 1 rle with old method : 0.08582901954650879 length of segment : 420 time for calcul the mask position with numpy : 0.0061190128326416016 nb_pixel_total : 119615 time to create 1 rle with old method : 0.13912391662597656 length of segment : 467 time for calcul the mask position with numpy : 0.004683017730712891 nb_pixel_total : 91007 time to create 1 rle with old method : 0.1013326644897461 length of segment : 489 time for calcul the mask position with numpy : 0.00017452239990234375 nb_pixel_total : 1252 time to create 1 rle with old method : 0.001560211181640625 length of segment : 45 time for calcul the mask position with numpy : 0.001984834671020508 nb_pixel_total : 32021 time to create 1 rle with old method : 0.03632307052612305 length of segment : 238 time for calcul the mask position with numpy : 0.0036325454711914062 nb_pixel_total : 77064 time to create 1 rle with old method : 0.0856020450592041 length of segment : 427 time for calcul the mask position with numpy : 0.0003814697265625 nb_pixel_total : 2981 time to create 1 rle with old method : 0.004563570022583008 length of segment : 64 time for calcul the mask position with numpy : 0.0017294883728027344 nb_pixel_total : 26152 time to create 1 rle with old method : 0.029657602310180664 length of segment : 250 time for calcul the mask position with numpy : 0.0006890296936035156 nb_pixel_total : 8353 time to create 1 rle with old method : 0.010024547576904297 length of segment : 125 time for calcul the mask position with numpy : 0.00037360191345214844 nb_pixel_total : 10498 time to create 1 rle with old method : 0.012392997741699219 length of segment : 144 time for calcul the mask position with numpy : 0.0016379356384277344 nb_pixel_total : 15647 time to create 1 rle with old method : 0.01784205436706543 length of segment : 333 time for calcul the mask position with numpy : 0.0010173320770263672 nb_pixel_total : 9678 time to create 1 rle with old method : 0.011468648910522461 length of segment : 176 time for calcul the mask position with numpy : 0.0011906623840332031 nb_pixel_total : 20107 time to create 1 rle with old method : 0.02326488494873047 length of segment : 216 time for calcul the mask position with numpy : 0.0006947517395019531 nb_pixel_total : 10148 time to create 1 rle with old method : 0.012220621109008789 length of segment : 107 time for calcul the mask position with numpy : 0.00034046173095703125 nb_pixel_total : 3332 time to create 1 rle with old method : 0.004042387008666992 length of segment : 86 time for calcul the mask position with numpy : 0.00013589859008789062 nb_pixel_total : 667 time to create 1 rle with old method : 0.0008809566497802734 length of segment : 32 time for calcul the mask position with numpy : 0.00035071372985839844 nb_pixel_total : 5058 time to create 1 rle with old method : 0.0062105655670166016 length of segment : 101 time for calcul the mask position with numpy : 0.0003142356872558594 nb_pixel_total : 8646 time to create 1 rle with old method : 0.009981870651245117 length of segment : 119 time for calcul the mask position with numpy : 0.00022339820861816406 nb_pixel_total : 3272 time to create 1 rle with old method : 0.004008054733276367 length of segment : 62 time for calcul the mask position with numpy : 0.00017213821411132812 nb_pixel_total : 1519 time to create 1 rle with old method : 0.00179290771484375 length of segment : 101 time for calcul the mask position with numpy : 0.0010390281677246094 nb_pixel_total : 14773 time to create 1 rle with old method : 0.016942977905273438 length of segment : 145 time for calcul the mask position with numpy : 0.0005445480346679688 nb_pixel_total : 6811 time to create 1 rle with old method : 0.0077593326568603516 length of segment : 139 time for calcul the mask position with numpy : 0.0009560585021972656 nb_pixel_total : 8874 time to create 1 rle with old method : 0.015253305435180664 length of segment : 199 time for calcul the mask position with numpy : 0.0003440380096435547 nb_pixel_total : 5981 time to create 1 rle with old method : 0.010350704193115234 length of segment : 196 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 1004 time to create 1 rle with old method : 0.0013267993927001953 length of segment : 39 time for calcul the mask position with numpy : 0.001157999038696289 nb_pixel_total : 16913 time to create 1 rle with old method : 0.01988387107849121 length of segment : 148 time for calcul the mask position with numpy : 0.0008311271667480469 nb_pixel_total : 13358 time to create 1 rle with old method : 0.015569925308227539 length of segment : 158 time for calcul the mask position with numpy : 0.0003981590270996094 nb_pixel_total : 3898 time to create 1 rle with old method : 0.004848957061767578 length of segment : 141 time for calcul the mask position with numpy : 0.0004220008850097656 nb_pixel_total : 4813 time to create 1 rle with old method : 0.005787849426269531 length of segment : 75 time for calcul the mask position with numpy : 0.0001881122589111328 nb_pixel_total : 4103 time to create 1 rle with old method : 0.004834413528442383 length of segment : 87 time for calcul the mask position with numpy : 0.00026297569274902344 nb_pixel_total : 4888 time to create 1 rle with old method : 0.005843639373779297 length of segment : 89 time for calcul the mask position with numpy : 0.00034117698669433594 nb_pixel_total : 8412 time to create 1 rle with old method : 0.009774446487426758 length of segment : 155 time for calcul the mask position with numpy : 0.00043702125549316406 nb_pixel_total : 9555 time to create 1 rle with old method : 0.011173248291015625 length of segment : 228 time for calcul the mask position with numpy : 0.0006587505340576172 nb_pixel_total : 12243 time to create 1 rle with old method : 0.014406681060791016 length of segment : 152 time for calcul the mask position with numpy : 0.00014519691467285156 nb_pixel_total : 4125 time to create 1 rle with old method : 0.004933357238769531 length of segment : 76 time for calcul the mask position with numpy : 0.0040247440338134766 nb_pixel_total : 98961 time to create 1 rle with old method : 0.10834407806396484 length of segment : 373 time for calcul the mask position with numpy : 0.0043408870697021484 nb_pixel_total : 100207 time to create 1 rle with old method : 0.10992622375488281 length of segment : 395 time for calcul the mask position with numpy : 0.005048036575317383 nb_pixel_total : 116109 time to create 1 rle with old method : 0.13511943817138672 length of segment : 461 time for calcul the mask position with numpy : 0.004544973373413086 nb_pixel_total : 102678 time to create 1 rle with old method : 0.11406230926513672 length of segment : 403 time for calcul the mask position with numpy : 0.001074075698852539 nb_pixel_total : 18113 time to create 1 rle with old method : 0.021657228469848633 length of segment : 120 time for calcul the mask position with numpy : 0.002771139144897461 nb_pixel_total : 49935 time to create 1 rle with old method : 0.05697298049926758 length of segment : 332 time for calcul the mask position with numpy : 0.0004935264587402344 nb_pixel_total : 6067 time to create 1 rle with old method : 0.007424354553222656 length of segment : 98 time for calcul the mask position with numpy : 0.0007212162017822266 nb_pixel_total : 4821 time to create 1 rle with old method : 0.0063800811767578125 length of segment : 101 time for calcul the mask position with numpy : 0.0009007453918457031 nb_pixel_total : 8420 time to create 1 rle with old method : 0.010003805160522461 length of segment : 159 time for calcul the mask position with numpy : 0.003789186477661133 nb_pixel_total : 86484 time to create 1 rle with old method : 0.10947060585021973 length of segment : 364 time for calcul the mask position with numpy : 0.0006399154663085938 nb_pixel_total : 12282 time to create 1 rle with old method : 0.01624894142150879 length of segment : 154 time for calcul the mask position with numpy : 0.0002200603485107422 nb_pixel_total : 2679 time to create 1 rle with old method : 0.003529787063598633 length of segment : 62 time for calcul the mask position with numpy : 0.0003521442413330078 nb_pixel_total : 4812 time to create 1 rle with old method : 0.006520986557006836 length of segment : 76 time for calcul the mask position with numpy : 0.00018858909606933594 nb_pixel_total : 1116 time to create 1 rle with old method : 0.0015728473663330078 length of segment : 64 time for calcul the mask position with numpy : 0.000530242919921875 nb_pixel_total : 5188 time to create 1 rle with old method : 0.007124423980712891 length of segment : 107 time for calcul the mask position with numpy : 0.001138925552368164 nb_pixel_total : 22893 time to create 1 rle with old method : 0.029575824737548828 length of segment : 158 time for calcul the mask position with numpy : 0.0011441707611083984 nb_pixel_total : 21053 time to create 1 rle with old method : 0.0288543701171875 length of segment : 175 time for calcul the mask position with numpy : 0.0008399486541748047 nb_pixel_total : 19149 time to create 1 rle with old method : 0.024779558181762695 length of segment : 185 time for calcul the mask position with numpy : 8.630752563476562e-05 nb_pixel_total : 358 time to create 1 rle with old method : 0.0005748271942138672 length of segment : 19 time for calcul the mask position with numpy : 0.0002484321594238281 nb_pixel_total : 5897 time to create 1 rle with old method : 0.007601022720336914 length of segment : 121 time for calcul the mask position with numpy : 0.0006201267242431641 nb_pixel_total : 7277 time to create 1 rle with old method : 0.008681535720825195 length of segment : 136 time for calcul the mask position with numpy : 0.0006601810455322266 nb_pixel_total : 9084 time to create 1 rle with old method : 0.010875463485717773 length of segment : 131 time for calcul the mask position with numpy : 0.0002319812774658203 nb_pixel_total : 4333 time to create 1 rle with old method : 0.005270719528198242 length of segment : 67 time for calcul the mask position with numpy : 0.000484466552734375 nb_pixel_total : 7106 time to create 1 rle with old method : 0.008662223815917969 length of segment : 190 time for calcul the mask position with numpy : 0.0003714561462402344 nb_pixel_total : 7038 time to create 1 rle with old method : 0.00891423225402832 length of segment : 118 time for calcul the mask position with numpy : 0.00028061866760253906 nb_pixel_total : 2160 time to create 1 rle with old method : 0.0037529468536376953 length of segment : 75 time for calcul the mask position with numpy : 0.0007965564727783203 nb_pixel_total : 16034 time to create 1 rle with old method : 0.029391765594482422 length of segment : 220 time for calcul the mask position with numpy : 0.0006496906280517578 nb_pixel_total : 9159 time to create 1 rle with old method : 0.016419172286987305 length of segment : 99 time for calcul the mask position with numpy : 0.0006144046783447266 nb_pixel_total : 12139 time to create 1 rle with old method : 0.016460180282592773 length of segment : 128 time for calcul the mask position with numpy : 0.0027837753295898438 nb_pixel_total : 106638 time to create 1 rle with old method : 0.12743663787841797 length of segment : 547 time for calcul the mask position with numpy : 0.0002162456512451172 nb_pixel_total : 3393 time to create 1 rle with old method : 0.0040416717529296875 length of segment : 71 time for calcul the mask position with numpy : 0.0005753040313720703 nb_pixel_total : 6021 time to create 1 rle with old method : 0.0071735382080078125 length of segment : 115 time for calcul the mask position with numpy : 0.000598907470703125 nb_pixel_total : 8753 time to create 1 rle with old method : 0.010265111923217773 length of segment : 96 time for calcul the mask position with numpy : 0.005132913589477539 nb_pixel_total : 88901 time to create 1 rle with old method : 0.12349057197570801 length of segment : 401 time for calcul the mask position with numpy : 0.00017333030700683594 nb_pixel_total : 1285 time to create 1 rle with old method : 0.0016200542449951172 length of segment : 40 time for calcul the mask position with numpy : 0.006175041198730469 nb_pixel_total : 123578 time to create 1 rle with old method : 0.13730192184448242 length of segment : 439 time for calcul the mask position with numpy : 0.0047914981842041016 nb_pixel_total : 87505 time to create 1 rle with old method : 0.09805178642272949 length of segment : 376 time for calcul the mask position with numpy : 0.00017309188842773438 nb_pixel_total : 1073 time to create 1 rle with old method : 0.0013954639434814453 length of segment : 39 time for calcul the mask position with numpy : 0.0004513263702392578 nb_pixel_total : 4208 time to create 1 rle with old method : 0.005361318588256836 length of segment : 117 time for calcul the mask position with numpy : 0.0009987354278564453 nb_pixel_total : 17246 time to create 1 rle with old method : 0.019745349884033203 length of segment : 148 time for calcul the mask position with numpy : 0.0010099411010742188 nb_pixel_total : 17859 time to create 1 rle with old method : 0.02822709083557129 length of segment : 232 time for calcul the mask position with numpy : 0.00409245491027832 nb_pixel_total : 89096 time to create 1 rle with old method : 0.11369895935058594 length of segment : 419 time for calcul the mask position with numpy : 0.0036306381225585938 nb_pixel_total : 63360 time to create 1 rle with old method : 0.07385516166687012 length of segment : 463 time for calcul the mask position with numpy : 0.0004935264587402344 nb_pixel_total : 5902 time to create 1 rle with old method : 0.007193088531494141 length of segment : 98 time for calcul the mask position with numpy : 0.00011777877807617188 nb_pixel_total : 931 time to create 1 rle with old method : 0.0011851787567138672 length of segment : 41 time for calcul the mask position with numpy : 0.0019805431365966797 nb_pixel_total : 25208 time to create 1 rle with old method : 0.0286102294921875 length of segment : 260 time for calcul the mask position with numpy : 0.0005090236663818359 nb_pixel_total : 4226 time to create 1 rle with old method : 0.007364749908447266 length of segment : 82 time for calcul the mask position with numpy : 0.00032067298889160156 nb_pixel_total : 1995 time to create 1 rle with old method : 0.0037508010864257812 length of segment : 46 time for calcul the mask position with numpy : 0.0005915164947509766 nb_pixel_total : 7854 time to create 1 rle with old method : 0.014293193817138672 length of segment : 97 time for calcul the mask position with numpy : 0.000148773193359375 nb_pixel_total : 1010 time to create 1 rle with old method : 0.0013420581817626953 length of segment : 41 time for calcul the mask position with numpy : 0.00043320655822753906 nb_pixel_total : 11660 time to create 1 rle with old method : 0.013445377349853516 length of segment : 256 time for calcul the mask position with numpy : 0.004012107849121094 nb_pixel_total : 134467 time to create 1 rle with old method : 0.1645359992980957 length of segment : 561 time for calcul the mask position with numpy : 0.00036525726318359375 nb_pixel_total : 4174 time to create 1 rle with old method : 0.0048825740814208984 length of segment : 85 time for calcul the mask position with numpy : 0.00025844573974609375 nb_pixel_total : 2772 time to create 1 rle with old method : 0.0035190582275390625 length of segment : 42 time for calcul the mask position with numpy : 9.322166442871094e-05 nb_pixel_total : 2247 time to create 1 rle with old method : 0.0027856826782226562 length of segment : 55 time for calcul the mask position with numpy : 0.0010766983032226562 nb_pixel_total : 7869 time to create 1 rle with old method : 0.011388063430786133 length of segment : 125 time for calcul the mask position with numpy : 0.00019741058349609375 nb_pixel_total : 4158 time to create 1 rle with old method : 0.0060427188873291016 length of segment : 72 time for calcul the mask position with numpy : 0.0005362033843994141 nb_pixel_total : 8103 time to create 1 rle with old method : 0.011555910110473633 length of segment : 71 time for calcul the mask position with numpy : 0.002884387969970703 nb_pixel_total : 54666 time to create 1 rle with old method : 0.06548404693603516 length of segment : 292 time for calcul the mask position with numpy : 0.0004551410675048828 nb_pixel_total : 6161 time to create 1 rle with old method : 0.00893712043762207 length of segment : 137 time for calcul the mask position with numpy : 0.000370025634765625 nb_pixel_total : 4438 time to create 1 rle with old method : 0.006536006927490234 length of segment : 88 time for calcul the mask position with numpy : 0.0002586841583251953 nb_pixel_total : 1655 time to create 1 rle with old method : 0.002574920654296875 length of segment : 43 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 476 time to create 1 rle with old method : 0.0007493495941162109 length of segment : 49 time for calcul the mask position with numpy : 0.0013298988342285156 nb_pixel_total : 16004 time to create 1 rle with old method : 0.020522594451904297 length of segment : 145 time for calcul the mask position with numpy : 0.0005514621734619141 nb_pixel_total : 2598 time to create 1 rle with old method : 0.003216981887817383 length of segment : 165 time for calcul the mask position with numpy : 0.0005650520324707031 nb_pixel_total : 6068 time to create 1 rle with old method : 0.0073397159576416016 length of segment : 103 time for calcul the mask position with numpy : 0.00023055076599121094 nb_pixel_total : 2195 time to create 1 rle with old method : 0.002778291702270508 length of segment : 66 time for calcul the mask position with numpy : 0.0005822181701660156 nb_pixel_total : 7715 time to create 1 rle with old method : 0.009830713272094727 length of segment : 110 time for calcul the mask position with numpy : 0.0002574920654296875 nb_pixel_total : 7235 time to create 1 rle with old method : 0.008866071701049805 length of segment : 141 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 562 time to create 1 rle with old method : 0.0007815361022949219 length of segment : 23 time for calcul the mask position with numpy : 0.0007166862487792969 nb_pixel_total : 7932 time to create 1 rle with old method : 0.009470701217651367 length of segment : 129 time for calcul the mask position with numpy : 0.002229452133178711 nb_pixel_total : 37817 time to create 1 rle with old method : 0.04373979568481445 length of segment : 218 time spent for convertir_results : 18.40213632583618 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 358 chid ids of type : 3760 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 58329 save missing photos in datou_result : time spend for datou_step_exec : 70.55011248588562 time spend to save output : 15.914759874343872 total time spend for step 1 : 86.46487236022949 step2:blur_detection Sat Feb 1 05:35:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 10 time used for this insertion : 0.009559154510498047 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 10 time used for this insertion : 2.095860004425049 save missing photos in datou_result : time spend for datou_step_exec : 0.01825261116027832 time spend to save output : 2.462784767150879 total time spend for step 2 : 2.4810373783111572 step3:brightness Sat Feb 1 05:35:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 10 time used for this insertion : 0.008908510208129883 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 10 time used for this insertion : 0.00894927978515625 save missing photos in datou_result : time spend for datou_step_exec : 0.021513700485229492 time spend to save output : 0.02250504493713379 total time spend for step 3 : 0.04401874542236328 step4:crop_condition Sat Feb 1 05:35:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3760 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 358 chid ids of type : 3760 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : barquette param for this class : {'min_score': 0.7} filtre for class : barquette hashtag_id of this class : 492787675 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 34 About to insert : list_path_to_insert length 34 new photo from crops ! About to upload 34 photos upload in portfolio : 4219792 init cache_photo without model_param we have 34 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738384563_3330313 we have uploaded 34 photos in the portfolio 4219792 time of upload the photos Elapsed time : 9.086644172668457 we have finished the crop for the class : barquette begin to crop the class : fibreux_cont param for this class : {'min_score': 0.7} filtre for class : fibreux_cont hashtag_id of this class : 2107756748 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 4219792 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738384573_3330313 we have uploaded 16 photos in the portfolio 4219792 time of upload the photos Elapsed time : 4.241802930831909 we have finished the crop for the class : fibreux_cont begin to crop the class : film_plastique param for this class : {'min_score': 0.7} filtre for class : film_plastique hashtag_id of this class : 2107756122 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 4219792 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738384578_3330313 we have uploaded 6 photos in the portfolio 4219792 time of upload the photos Elapsed time : 1.430842399597168 we have finished the crop for the class : film_plastique begin to crop the class : autre_contaminant param for this class : {'min_score': 0.7} filtre for class : autre_contaminant hashtag_id of this class : 2107756781 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 86 About to insert : list_path_to_insert length 86 new photo from crops ! About to upload 86 photos upload in portfolio : 4219792 init cache_photo without model_param we have 86 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738384583_3330313 we have uploaded 86 photos in the portfolio 4219792 time of upload the photos Elapsed time : 20.21857237815857 we have finished the crop for the class : autre_contaminant begin to crop the class : etiquette_detachee param for this class : {'min_score': 0.7} filtre for class : etiquette_detachee hashtag_id of this class : 2107756860 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 4219792 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738384604_3330313 we have uploaded 5 photos in the portfolio 4219792 time of upload the photos Elapsed time : 2.770761489868164 we have finished the crop for the class : etiquette_detachee begin to crop the class : pet_clair_cont param for this class : {'min_score': 0.7} filtre for class : pet_clair_cont hashtag_id of this class : 2107758154 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 4219792 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738384609_3330313 we have uploaded 26 photos in the portfolio 4219792 time of upload the photos Elapsed time : 6.6530210971832275 we have finished the crop for the class : pet_clair_cont begin to crop the class : metal_cont param for this class : {'min_score': 0.7} filtre for class : metal_cont hashtag_id of this class : 2107756749 begin to crop the class : pet_fonce_cont param for this class : {'min_score': 0.7} filtre for class : pet_fonce_cont hashtag_id of this class : 2107758155 begin to crop the class : pet_opaque_cont param for this class : {'min_score': 0.7} filtre for class : pet_opaque_cont hashtag_id of this class : 2107758156 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 56 About to insert : list_path_to_insert length 56 new photo from crops ! About to upload 56 photos upload in portfolio : 4219792 init cache_photo without model_param we have 56 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738384619_3330313 we have uploaded 56 photos in the portfolio 4219792 time of upload the photos Elapsed time : 12.326531887054443 we have finished the crop for the class : pet_opaque_cont delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1330289704, 1330289697, 1330289693, 1330289691, 1330289663, 1330289661, 1330289652, 1330289649, 1330289646, 1330289644] Looping around the photos to save general results len do output : 229 /1333607334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289704', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289697', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289693', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289691', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289663', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289661', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289652', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289649', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289646', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289644', None, None, None, None, None, '2533517') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 697 time used for this insertion : 0.04480314254760742 save_final save missing photos in datou_result : time spend for datou_step_exec : 74.56207966804504 time spend to save output : 0.09254288673400879 total time spend for step 4 : 74.65462255477905 step5:thcl Sat Feb 1 05:37:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3233 time to import caffe and check if the image exist : 0.01464080810546875 time to convert the images to numpy array : 0.08452558517456055 time to import caffe and check if the image exist : 0.02420973777770996 time to convert the images to numpy array : 0.07739758491516113 time to import caffe and check if the image exist : 0.01776576042175293 time to convert the images to numpy array : 0.0852043628692627 time to import caffe and check if the image exist : 0.020854473114013672 time to convert the images to numpy array : 0.0847163200378418 time to import caffe and check if the image exist : 0.015729904174804688 time to convert the images to numpy array : 0.09126114845275879 time to import caffe and check if the image exist : 0.012852907180786133 time to convert the images to numpy array : 0.09758520126342773 time to import caffe and check if the image exist : 0.019598007202148438 time to convert the images to numpy array : 0.08884763717651367 time to import caffe and check if the image exist : 0.02320122718811035 time to convert the images to numpy array : 0.09154844284057617 time to import caffe and check if the image exist : 0.02742910385131836 time to convert the images to numpy array : 0.08670544624328613 time to import caffe and check if the image exist : 0.017391204833984375 time to convert the images to numpy array : 0.10990023612976074 total time to convert the images to numpy array : 1.1057007312774658 list photo_ids error: [] list photo_ids correct : [1333607382, 1333607383, 1333607384, 1333607385, 1333607386, 1333607387, 1333607388, 1333607389, 1333607390, 1333607391, 1333607457, 1333607458, 1333607459, 1333607460, 1333607461, 1333607462, 1333607463, 1333607464, 1333607465, 1333607466, 1333607467, 1333607468, 1333607469, 1333607470, 1333607471, 1333607473, 1333607474, 1333607475, 1333607476, 1333607477, 1333607478, 1333607479, 1333607480, 1333607481, 1333607482, 1333607483, 1333607484, 1333607485, 1333607486, 1333607488, 1333607489, 1333607490, 1333607491, 1333607492, 1333607493, 1333607494, 1333607518, 1333607519, 1333607520, 1333607521, 1333607522, 1333607523, 1333607524, 1333607526, 1333607527, 1333607528, 1333607529, 1333607531, 1333607532, 1333607533, 1333607534, 1333607535, 1333607536, 1333607537, 1333607538, 1333607539, 1333607540, 1333607541, 1333607542, 1333607495, 1333607496, 1333607497, 1333607498, 1333607499, 1333607500, 1333607501, 1333607502, 1333607503, 1333607504, 1333607505, 1333607506, 1333607507, 1333607508, 1333607509, 1333607510, 1333607511, 1333607512, 1333607513, 1333607514, 1333607515, 1333607516, 1333607517, 1333607652, 1333607653, 1333607654, 1333607655, 1333607656, 1333607657, 1333607658, 1333607659, 1333607660, 1333607661, 1333607662, 1333607664, 1333607665, 1333607666, 1333607667, 1333607668, 1333607669, 1333607670, 1333607671, 1333607672, 1333607673, 1333607674, 1333607543, 1333607544, 1333607545, 1333607546, 1333607549, 1333607550, 1333607551, 1333607552, 1333607553, 1333607585, 1333607586, 1333607587, 1333607588, 1333607589, 1333607590, 1333607591, 1333607592, 1333607593, 1333607594, 1333607595, 1333607596, 1333607597, 1333607598, 1333607629, 1333607630, 1333607631, 1333607632, 1333607633, 1333607634, 1333607635, 1333607636, 1333607637, 1333607638, 1333607639, 1333607640, 1333607641, 1333607642, 1333607643, 1333607644, 1333607645, 1333607646, 1333607647, 1333607648, 1333607649, 1333607650, 1333607651, 1333607357, 1333607358, 1333607359, 1333607360, 1333607361, 1333607362, 1333607363, 1333607364, 1333607365, 1333607366, 1333607367, 1333607370, 1333607371, 1333607372, 1333607373, 1333607374, 1333607375, 1333607376, 1333607377, 1333607378, 1333607379, 1333607380, 1333607381, 1333607599, 1333607600, 1333607601, 1333607602, 1333607603, 1333607604, 1333607605, 1333607606, 1333607607, 1333607608, 1333607610, 1333607611, 1333607618, 1333607619, 1333607620, 1333607621, 1333607622, 1333607623, 1333607624, 1333607625, 1333607626, 1333607627, 1333607628, 1333607334, 1333607335, 1333607336, 1333607337, 1333607338, 1333607339, 1333607340, 1333607341, 1333607342, 1333607343, 1333607344, 1333607345, 1333607346, 1333607347, 1333607348, 1333607349, 1333607350, 1333607351, 1333607352, 1333607353, 1333607354, 1333607355, 1333607356] number of photos to traite : 229 try to delete the photos incorrect in DB tagging for thcl : 3233 To do loadFromThcl(), then load ParamDescType : thcl3233 thcls : [{'id': 3233, 'mtr_user_id': 31, 'name': 'learn_generique_01122021_6000_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'barquette_opaque,carton,ela,environnement,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_fonce,pet_opaque,textiles_sanitaires', 'svm_portfolios_learning': '4825680,4829009,4825557,4824709,4824714,4824733,4825676,4824737,4824753,4829002,4824848,4824863,4825667,4825677', 'photo_hashtag_type': 4151, 'photo_desc_type': 5557, 'type_classification': 'caffe', 'hashtag_id_list': '2107760128,492774966,492741797,493012381,492636447,2107756122,493202403,492628673,492668766,628944319,2107755846,2107755900,2107759152,2107760129'}] thcl {'id': 3233, 'mtr_user_id': 31, 'name': 'learn_generique_01122021_6000_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'barquette_opaque,carton,ela,environnement,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_fonce,pet_opaque,textiles_sanitaires', 'svm_portfolios_learning': '4825680,4829009,4825557,4824709,4824714,4824733,4825676,4824737,4824753,4829002,4824848,4824863,4825667,4825677', 'photo_hashtag_type': 4151, 'photo_desc_type': 5557, 'type_classification': 'caffe', 'hashtag_id_list': '2107760128,492774966,492741797,493012381,492636447,2107756122,493202403,492628673,492668766,628944319,2107755846,2107755900,2107759152,2107760129'} Update svm_hashtag_type_desc : 5557 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5557, 'learn_generique_01122021_6000_v2', 2048, 2048, 'learn_generique_01122021_6000_v2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 1, 19, 59, 17), datetime.datetime(2021, 12, 1, 19, 59, 17)) To loadFromThcl() : net_5557 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5557, 'learn_generique_01122021_6000_v2', 2048, 2048, 'learn_generique_01122021_6000_v2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 1, 19, 59, 17), datetime.datetime(2021, 12, 1, 19, 59, 17)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_generique_01122021_6000_v2 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_generique_01122021_6000_v2 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_generique_01122021_6000_v2 /data/models_weight/learn_generique_01122021_6000_v2/caffemodel size_local : 94383085 size in s3 : 94383085 create time local : 2021-12-09 17:03:46 create time in s3 : 2021-12-01 18:45:54 caffemodel already exist and didn't need to update /data/models_weight/learn_generique_01122021_6000_v2/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-09 17:03:46 create time in s3 : 2021-12-01 18:45:53 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_generique_01122021_6000_v2/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-09 17:03:47 create time in s3 : 2021-12-01 18:59:02 mean.npy already exist and didn't need to update /data/models_weight/learn_generique_01122021_6000_v2/synset_words.txt size_local : 454 size in s3 : 454 create time local : 2021-12-09 17:03:47 create time in s3 : 2021-12-01 18:59:15 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_generique_01122021_6000_v2/deploy.prototxt caffemodel_filename : /data/models_weight/learn_generique_01122021_6000_v2/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10776 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.146594762802124 time used to do the prediction : 0.8750030994415283 save descriptor for thcl : 3233 time to traite the descriptors : 1.2625255584716797 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1333607382 To insert : 1333607383 To insert : 1333607384 To insert : 1333607385 To insert : 1333607386 To insert : 1333607387 To insert : 1333607388 To insert : 1333607389 To insert : 1333607390 To insert : 1333607391 To insert : 1333607457 To insert : 1333607458 To insert : 1333607459 To insert : 1333607460 To insert : 1333607461 To insert : 1333607462 To insert : 1333607463 To insert : 1333607464 To insert : 1333607465 To insert : 1333607466 To insert : 1333607467 To insert : 1333607468 To insert : 1333607469 To insert : 1333607470 To insert : 1333607471 To insert : 1333607473 To insert : 1333607474 To insert : 1333607475 To insert : 1333607476 To insert : 1333607477 To insert : 1333607478 To insert : 1333607479 To insert : 1333607480 To insert : 1333607481 To insert : 1333607482 To insert : 1333607483 To insert : 1333607484 To insert : 1333607485 To insert : 1333607486 To insert : 1333607488 To insert : 1333607489 To insert : 1333607490 To insert : 1333607491 To insert : 1333607492 To insert : 1333607493 To insert : 1333607494 To insert : 1333607518 To insert : 1333607519 To insert : 1333607520 To insert : 1333607521 To insert : 1333607522 To insert : 1333607523 To insert : 1333607524 To insert : 1333607526 To insert : 1333607527 To insert : 1333607528 To insert : 1333607529 To insert : 1333607531 To insert : 1333607532 To insert : 1333607533 To insert : 1333607534 To insert : 1333607535 To insert : 1333607536 To insert : 1333607537 To insert : 1333607538 To insert : 1333607539 To insert : 1333607540 To insert : 1333607541 To insert : 1333607542 To insert : 1333607495 To insert : 1333607496 To insert : 1333607497 To insert : 1333607498 To insert : 1333607499 To insert : 1333607500 To insert : 1333607501 To insert : 1333607502 To insert : 1333607503 To insert : 1333607504 To insert : 1333607505 To insert : 1333607506 To insert : 1333607507 To insert : 1333607508 To insert : 1333607509 To insert : 1333607510 To insert : 1333607511 To insert : 1333607512 To insert : 1333607513 To insert : 1333607514 To insert : 1333607515 To insert : 1333607516 To insert : 1333607517 To insert : 1333607652 To insert : 1333607653 To insert : 1333607654 To insert : 1333607655 To insert : 1333607656 To insert : 1333607657 To insert : 1333607658 To insert : 1333607659 To insert : 1333607660 To insert : 1333607661 To insert : 1333607662 To insert : 1333607664 To insert : 1333607665 To insert : 1333607666 To insert : 1333607667 To insert : 1333607668 To insert : 1333607669 To insert : 1333607670 To insert : 1333607671 To insert : 1333607672 To insert : 1333607673 To insert : 1333607674 To insert : 1333607543 To insert : 1333607544 To insert : 1333607545 To insert : 1333607546 To insert : 1333607549 To insert : 1333607550 To insert : 1333607551 To insert : 1333607552 To insert : 1333607553 To insert : 1333607585 To insert : 1333607586 To insert : 1333607587 To insert : 1333607588 To insert : 1333607589 To insert : 1333607590 To insert : 1333607591 To insert : 1333607592 To insert : 1333607593 To insert : 1333607594 To insert : 1333607595 To insert : 1333607596 To insert : 1333607597 To insert : 1333607598 To insert : 1333607629 To insert : 1333607630 To insert : 1333607631 To insert : 1333607632 To insert : 1333607633 To insert : 1333607634 To insert : 1333607635 To insert : 1333607636 To insert : 1333607637 To insert : 1333607638 To insert : 1333607639 To insert : 1333607640 To insert : 1333607641 To insert : 1333607642 To insert : 1333607643 To insert : 1333607644 To insert : 1333607645 To insert : 1333607646 To insert : 1333607647 To insert : 1333607648 To insert : 1333607649 To insert : 1333607650 To insert : 1333607651 To insert : 1333607357 To insert : 1333607358 To insert : 1333607359 To insert : 1333607360 To insert : 1333607361 To insert : 1333607362 To insert : 1333607363 To insert : 1333607364 To insert : 1333607365 To insert : 1333607366 To insert : 1333607367 To insert : 1333607370 To insert : 1333607371 To insert : 1333607372 To insert : 1333607373 To insert : 1333607374 To insert : 1333607375 To insert : 1333607376 To insert : 1333607377 To insert : 1333607378 To insert : 1333607379 To insert : 1333607380 To insert : 1333607381 To insert : 1333607599 To insert : 1333607600 To insert : 1333607601 To insert : 1333607602 To insert : 1333607603 To insert : 1333607604 To insert : 1333607605 To insert : 1333607606 To insert : 1333607607 To insert : 1333607608 To insert : 1333607610 To insert : 1333607611 To insert : 1333607618 To insert : 1333607619 To insert : 1333607620 To insert : 1333607621 To insert : 1333607622 To insert : 1333607623 To insert : 1333607624 To insert : 1333607625 To insert : 1333607626 To insert : 1333607627 To insert : 1333607628 To insert : 1333607334 To insert : 1333607335 To insert : 1333607336 To insert : 1333607337 To insert : 1333607338 To insert : 1333607339 To insert : 1333607340 To insert : 1333607341 To insert : 1333607342 To insert : 1333607343 To insert : 1333607344 To insert : 1333607345 To insert : 1333607346 To insert : 1333607347 To insert : 1333607348 To insert : 1333607349 To insert : 1333607350 To insert : 1333607351 To insert : 1333607352 To insert : 1333607353 To insert : 1333607354 To insert : 1333607355 To insert : 1333607356 time to insert the descriptors : 41.66923761367798 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 328 time used for this insertion : 0.027882814407348633 save missing photos in datou_result : time spend for datou_step_exec : 50.41618466377258 time spend to save output : 0.09329867362976074 total time spend for step 5 : 50.509483337402344 step6:argmax Sat Feb 1 05:38:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou_step Argmax ! calculate argmax for thcl : 3233 Inside saveOutput : final : False verbose : 0 photo_id : 1333607382 output[photo_id] : [('1333607382', 'etiquette', 0.78318197, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484638_0.png'] photo_id : 1333607383 output[photo_id] : [('1333607383', 'etiquette', 0.49886295, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484690_0.png'] photo_id : 1333607384 output[photo_id] : [('1333607384', 'papier', 0.7440283, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484672_0.png'] photo_id : 1333607385 output[photo_id] : [('1333607385', 'etiquette', 0.9127913, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484686_0.png'] photo_id : 1333607386 output[photo_id] : [('1333607386', 'barquette_opaque', 0.30544627, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484409_0.png'] photo_id : 1333607387 output[photo_id] : [('1333607387', 'carton', 0.65986544, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484505_0.png'] photo_id : 1333607388 output[photo_id] : [('1333607388', 'etiquette', 0.31038228, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484618_0.png'] photo_id : 1333607389 output[photo_id] : [('1333607389', 'barquette_opaque', 0.49908242, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484647_0.png'] photo_id : 1333607390 output[photo_id] : [('1333607390', 'etiquette', 0.5992397, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484681_0.png'] photo_id : 1333607391 output[photo_id] : [('1333607391', 'papier', 0.7455576, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484691_0.png'] photo_id : 1333607457 output[photo_id] : [('1333607457', 'pet_fonce', 0.30357137, 4151, '3233'), 'temp/1738384468_3330313_1330289704_055f7d562f55bd353e82ba1c69b0e7cc_rle_crop_3626484391_0.png'] photo_id : 1333607458 output[photo_id] : [('1333607458', 'etiquette', 0.9120883, 4151, '3233'), 'temp/1738384468_3330313_1330289704_055f7d562f55bd353e82ba1c69b0e7cc_rle_crop_3626484386_0.png'] photo_id : 1333607459 output[photo_id] : [('1333607459', 'pet_fonce', 0.3285756, 4151, '3233'), 'temp/1738384468_3330313_1330289704_055f7d562f55bd353e82ba1c69b0e7cc_rle_crop_3626484382_0.png'] photo_id : 1333607460 output[photo_id] : [('1333607460', 'etiquette', 0.5845645, 4151, '3233'), 'temp/1738384468_3330313_1330289704_055f7d562f55bd353e82ba1c69b0e7cc_rle_crop_3626484389_0.png'] photo_id : 1333607461 output[photo_id] : [('1333607461', 'etiquette', 0.40721634, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484413_0.png'] photo_id : 1333607462 output[photo_id] : [('1333607462', 'etiquette', 0.48340896, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484400_0.png'] photo_id : 1333607463 output[photo_id] : [('1333607463', 'papier', 0.9134876, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484408_0.png'] photo_id : 1333607464 output[photo_id] : [('1333607464', 'etiquette', 0.6212717, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484423_0.png'] photo_id : 1333607465 output[photo_id] : [('1333607465', 'barquette_opaque', 0.886574, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484419_0.png'] photo_id : 1333607466 output[photo_id] : [('1333607466', 'ela', 0.5918613, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484407_0.png'] photo_id : 1333607467 output[photo_id] : [('1333607467', 'barquette_opaque', 0.51279306, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484422_0.png'] photo_id : 1333607468 output[photo_id] : [('1333607468', 'etiquette', 0.47732246, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484406_0.png'] photo_id : 1333607469 output[photo_id] : [('1333607469', 'etiquette', 0.50750893, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484401_0.png'] photo_id : 1333607470 output[photo_id] : [('1333607470', 'papier', 0.39218202, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484402_0.png'] photo_id : 1333607471 output[photo_id] : [('1333607471', 'etiquette', 0.35264415, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484405_0.png'] photo_id : 1333607473 output[photo_id] : [('1333607473', 'metal', 0.6810949, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484447_0.png'] photo_id : 1333607474 output[photo_id] : [('1333607474', 'barquette_opaque', 0.56206334, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484458_0.png'] photo_id : 1333607475 output[photo_id] : [('1333607475', 'etiquette', 0.24433127, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484453_0.png'] photo_id : 1333607476 output[photo_id] : [('1333607476', 'etiquette', 0.43333173, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484452_0.png'] photo_id : 1333607477 output[photo_id] : [('1333607477', 'etiquette', 0.3331789, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484451_0.png'] photo_id : 1333607478 output[photo_id] : [('1333607478', 'barquette_opaque', 0.66017365, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484449_0.png'] photo_id : 1333607479 output[photo_id] : [('1333607479', 'barquette_opaque', 0.8841276, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484444_0.png'] photo_id : 1333607480 output[photo_id] : [('1333607480', 'pet_opaque', 0.30238798, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484448_0.png'] photo_id : 1333607481 output[photo_id] : [('1333607481', 'barquette_opaque', 0.4938861, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484430_0.png'] photo_id : 1333607482 output[photo_id] : [('1333607482', 'pet_fonce', 0.36513302, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484492_0.png'] photo_id : 1333607483 output[photo_id] : [('1333607483', 'etiquette', 0.510111, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484464_0.png'] photo_id : 1333607484 output[photo_id] : [('1333607484', 'papier', 0.58550704, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484486_0.png'] photo_id : 1333607485 output[photo_id] : [('1333607485', 'etiquette', 0.637143, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484493_0.png'] photo_id : 1333607486 output[photo_id] : [('1333607486', 'etiquette', 0.3638077, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484467_0.png'] photo_id : 1333607488 output[photo_id] : [('1333607488', 'papier', 0.60548866, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484484_0.png'] photo_id : 1333607489 output[photo_id] : [('1333607489', 'barquette_opaque', 0.72875035, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484475_0.png'] photo_id : 1333607490 output[photo_id] : [('1333607490', 'environnement', 0.6742467, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484465_0.png'] photo_id : 1333607491 output[photo_id] : [('1333607491', 'film_plastique', 0.78841585, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484487_0.png'] photo_id : 1333607492 output[photo_id] : [('1333607492', 'papier', 0.48282748, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484470_0.png'] photo_id : 1333607493 output[photo_id] : [('1333607493', 'etiquette', 0.5531545, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484508_0.png'] photo_id : 1333607494 output[photo_id] : [('1333607494', 'etiquette', 0.5011673, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484509_0.png'] photo_id : 1333607518 output[photo_id] : [('1333607518', 'environnement', 0.34368563, 4151, '3233'), 'temp/1738384468_3330313_1330289652_e7fa8ab7a03cd37766698452abd8d48f_rle_crop_3626484587_0.png'] photo_id : 1333607519 output[photo_id] : [('1333607519', 'barquette_opaque', 0.39239627, 4151, '3233'), 'temp/1738384468_3330313_1330289652_e7fa8ab7a03cd37766698452abd8d48f_rle_crop_3626484582_0.png'] photo_id : 1333607520 output[photo_id] : [('1333607520', 'metal', 0.7472104, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484626_0.png'] photo_id : 1333607521 output[photo_id] : [('1333607521', 'etiquette', 0.66919357, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484611_0.png'] photo_id : 1333607522 output[photo_id] : [('1333607522', 'carton', 0.6799891, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484622_0.png'] photo_id : 1333607523 output[photo_id] : [('1333607523', 'environnement', 0.39609507, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484619_0.png'] photo_id : 1333607524 output[photo_id] : [('1333607524', 'etiquette', 0.21607167, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484624_0.png'] photo_id : 1333607526 output[photo_id] : [('1333607526', 'etiquette', 0.602373, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484607_0.png'] photo_id : 1333607527 output[photo_id] : [('1333607527', 'papier', 0.75908786, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3648358060_0.png'] photo_id : 1333607528 output[photo_id] : [('1333607528', 'barquette_opaque', 0.29861283, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484646_0.png'] photo_id : 1333607529 output[photo_id] : [('1333607529', 'etiquette', 0.5770787, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484656_0.png'] photo_id : 1333607531 output[photo_id] : [('1333607531', 'papier', 0.9487929, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484649_0.png'] photo_id : 1333607532 output[photo_id] : [('1333607532', 'etiquette', 0.43343803, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484648_0.png'] photo_id : 1333607533 output[photo_id] : [('1333607533', 'barquette_opaque', 0.9251291, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484633_0.png'] photo_id : 1333607534 output[photo_id] : [('1333607534', 'environnement', 0.35745412, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484650_0.png'] photo_id : 1333607535 output[photo_id] : [('1333607535', 'environnement', 0.37561938, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484652_0.png'] photo_id : 1333607536 output[photo_id] : [('1333607536', 'pet_fonce', 0.64523214, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484637_0.png'] photo_id : 1333607537 output[photo_id] : [('1333607537', 'etiquette', 0.5305453, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484685_0.png'] photo_id : 1333607538 output[photo_id] : [('1333607538', 'pet_opaque', 0.4442031, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484675_0.png'] photo_id : 1333607539 output[photo_id] : [('1333607539', 'barquette_opaque', 0.7449234, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484680_0.png'] photo_id : 1333607540 output[photo_id] : [('1333607540', 'barquette_opaque', 0.76803553, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484669_0.png'] photo_id : 1333607541 output[photo_id] : [('1333607541', 'etiquette', 0.5161403, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484673_0.png'] photo_id : 1333607542 output[photo_id] : [('1333607542', 'papier', 0.81689173, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484689_0.png'] photo_id : 1333607495 output[photo_id] : [('1333607495', 'etiquette', 0.5332143, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484515_0.png'] photo_id : 1333607496 output[photo_id] : [('1333607496', 'etiquette', 0.55375427, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484518_0.png'] photo_id : 1333607497 output[photo_id] : [('1333607497', 'barquette_opaque', 0.5608848, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484511_0.png'] photo_id : 1333607498 output[photo_id] : [('1333607498', 'pet_fonce', 0.460118, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484507_0.png'] photo_id : 1333607499 output[photo_id] : [('1333607499', 'etiquette', 0.9786962, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484513_0.png'] photo_id : 1333607500 output[photo_id] : [('1333607500', 'pet_fonce', 0.7310365, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484530_0.png'] photo_id : 1333607501 output[photo_id] : [('1333607501', 'etiquette', 0.64937055, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484544_0.png'] photo_id : 1333607502 output[photo_id] : [('1333607502', 'etiquette', 0.50988424, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484528_0.png'] photo_id : 1333607503 output[photo_id] : [('1333607503', 'papier', 0.6196422, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484537_0.png'] photo_id : 1333607504 output[photo_id] : [('1333607504', 'papier', 0.9271642, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484548_0.png'] photo_id : 1333607505 output[photo_id] : [('1333607505', 'etiquette', 0.53276503, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484531_0.png'] photo_id : 1333607506 output[photo_id] : [('1333607506', 'pet_fonce', 0.44550377, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484551_0.png'] photo_id : 1333607507 output[photo_id] : [('1333607507', 'pet_opaque', 0.65872717, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484540_0.png'] photo_id : 1333607508 output[photo_id] : [('1333607508', 'metal', 0.8453948, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3648358047_0.png'] photo_id : 1333607509 output[photo_id] : [('1333607509', 'etiquette', 0.9508444, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484538_0.png'] photo_id : 1333607510 output[photo_id] : [('1333607510', 'barquette_opaque', 0.5635998, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484533_0.png'] photo_id : 1333607511 output[photo_id] : [('1333607511', 'carton', 0.2836608, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484549_0.png'] photo_id : 1333607512 output[photo_id] : [('1333607512', 'etiquette', 0.3912619, 4151, '3233'), 'temp/1738384468_3330313_1330289652_e7fa8ab7a03cd37766698452abd8d48f_rle_crop_3626484558_0.png'] photo_id : 1333607513 output[photo_id] : [('1333607513', 'etiquette', 0.84468347, 4151, '3233'), 'temp/1738384468_3330313_1330289652_e7fa8ab7a03cd37766698452abd8d48f_rle_crop_3626484565_0.png'] photo_id : 1333607514 output[photo_id] : [('1333607514', 'barquette_opaque', 0.52125436, 4151, '3233'), 'temp/1738384468_3330313_1330289652_e7fa8ab7a03cd37766698452abd8d48f_rle_crop_3626484562_0.png'] photo_id : 1333607515 output[photo_id] : [('1333607515', 'etiquette', 0.58694965, 4151, '3233'), 'temp/1738384468_3330313_1330289652_e7fa8ab7a03cd37766698452abd8d48f_rle_crop_3648358051_0.png'] photo_id : 1333607516 output[photo_id] : [('1333607516', 'etiquette', 0.82244545, 4151, '3233'), 'temp/1738384468_3330313_1330289652_e7fa8ab7a03cd37766698452abd8d48f_rle_crop_3626484573_0.png'] photo_id : 1333607517 output[photo_id] : [('1333607517', 'etiquette', 0.50582165, 4151, '3233'), 'temp/1738384468_3330313_1330289652_e7fa8ab7a03cd37766698452abd8d48f_rle_crop_3648358052_0.png'] photo_id : 1333607652 output[photo_id] : [('1333607652', 'papier', 0.44771478, 4151, '3233'), 'temp/1738384468_3330313_1330289652_e7fa8ab7a03cd37766698452abd8d48f_rle_crop_3626484561_0.png'] photo_id : 1333607653 output[photo_id] : [('1333607653', 'etiquette', 0.9946032, 4151, '3233'), 'temp/1738384468_3330313_1330289652_e7fa8ab7a03cd37766698452abd8d48f_rle_crop_3626484581_0.png'] photo_id : 1333607654 output[photo_id] : [('1333607654', 'barquette_opaque', 0.8552379, 4151, '3233'), 'temp/1738384468_3330313_1330289652_e7fa8ab7a03cd37766698452abd8d48f_rle_crop_3626484575_0.png'] photo_id : 1333607655 output[photo_id] : [('1333607655', 'barquette_opaque', 0.6269084, 4151, '3233'), 'temp/1738384468_3330313_1330289652_e7fa8ab7a03cd37766698452abd8d48f_rle_crop_3648358053_0.png'] photo_id : 1333607656 output[photo_id] : [('1333607656', 'papier', 0.99991846, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484603_0.png'] photo_id : 1333607657 output[photo_id] : [('1333607657', 'barquette_opaque', 0.9845653, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484614_0.png'] photo_id : 1333607658 output[photo_id] : [('1333607658', 'papier', 0.98371255, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484623_0.png'] photo_id : 1333607659 output[photo_id] : [('1333607659', 'papier', 0.8192076, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484599_0.png'] photo_id : 1333607660 output[photo_id] : [('1333607660', 'barquette_opaque', 0.56979865, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3648358059_0.png'] photo_id : 1333607661 output[photo_id] : [('1333607661', 'barquette_opaque', 0.9943151, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484601_0.png'] photo_id : 1333607662 output[photo_id] : [('1333607662', 'etiquette', 0.99839455, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484657_0.png'] photo_id : 1333607664 output[photo_id] : [('1333607664', 'barquette_opaque', 0.99981123, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484654_0.png'] photo_id : 1333607665 output[photo_id] : [('1333607665', 'papier', 0.31722975, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484636_0.png'] photo_id : 1333607666 output[photo_id] : [('1333607666', 'papier', 0.990747, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484631_0.png'] photo_id : 1333607667 output[photo_id] : [('1333607667', 'barquette_opaque', 0.9908522, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484644_0.png'] photo_id : 1333607668 output[photo_id] : [('1333607668', 'pet_fonce', 0.45978332, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484643_0.png'] photo_id : 1333607669 output[photo_id] : [('1333607669', 'pet_opaque', 0.7209649, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3648358065_0.png'] photo_id : 1333607670 output[photo_id] : [('1333607670', 'etiquette', 0.74400353, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484694_0.png'] photo_id : 1333607671 output[photo_id] : [('1333607671', 'barquette_opaque', 0.8366462, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484693_0.png'] photo_id : 1333607672 output[photo_id] : [('1333607672', 'barquette_opaque', 0.99581283, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484684_0.png'] photo_id : 1333607673 output[photo_id] : [('1333607673', 'etiquette', 0.6996974, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484664_0.png'] photo_id : 1333607674 output[photo_id] : [('1333607674', 'barquette_opaque', 0.62964165, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484666_0.png'] photo_id : 1333607543 output[photo_id] : [('1333607543', 'metal', 0.2424457, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484678_0.png'] photo_id : 1333607544 output[photo_id] : [('1333607544', 'barquette_opaque', 0.9232923, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484696_0.png'] photo_id : 1333607545 output[photo_id] : [('1333607545', 'etiquette', 0.85537004, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484692_0.png'] photo_id : 1333607546 output[photo_id] : [('1333607546', 'etiquette', 0.43843213, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484679_0.png'] photo_id : 1333607549 output[photo_id] : [('1333607549', 'etiquette', 0.96391124, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484404_0.png'] photo_id : 1333607550 output[photo_id] : [('1333607550', 'etiquette', 0.89769095, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484543_0.png'] photo_id : 1333607551 output[photo_id] : [('1333607551', 'etiquette', 0.62261444, 4151, '3233'), 'temp/1738384468_3330313_1330289652_e7fa8ab7a03cd37766698452abd8d48f_rle_crop_3626484568_0.png'] photo_id : 1333607552 output[photo_id] : [('1333607552', 'etiquette', 0.9894875, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484609_0.png'] photo_id : 1333607553 output[photo_id] : [('1333607553', 'etiquette', 0.6241272, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484641_0.png'] photo_id : 1333607585 output[photo_id] : [('1333607585', 'environnement', 0.3798841, 4151, '3233'), 'temp/1738384468_3330313_1330289704_055f7d562f55bd353e82ba1c69b0e7cc_rle_crop_3626484388_0.png'] photo_id : 1333607586 output[photo_id] : [('1333607586', 'pet_clair', 0.3102205, 4151, '3233'), 'temp/1738384468_3330313_1330289704_055f7d562f55bd353e82ba1c69b0e7cc_rle_crop_3626484384_0.png'] photo_id : 1333607587 output[photo_id] : [('1333607587', 'metal', 0.49165276, 4151, '3233'), 'temp/1738384468_3330313_1330289704_055f7d562f55bd353e82ba1c69b0e7cc_rle_crop_3626484375_0.png'] photo_id : 1333607588 output[photo_id] : [('1333607588', 'film_plastique', 0.6048952, 4151, '3233'), 'temp/1738384468_3330313_1330289704_055f7d562f55bd353e82ba1c69b0e7cc_rle_crop_3626484390_0.png'] photo_id : 1333607589 output[photo_id] : [('1333607589', 'pet_fonce', 0.49424827, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484421_0.png'] photo_id : 1333607590 output[photo_id] : [('1333607590', 'etiquette', 0.35285965, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484420_0.png'] photo_id : 1333607591 output[photo_id] : [('1333607591', 'pet_fonce', 0.15177521, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484494_0.png'] photo_id : 1333607592 output[photo_id] : [('1333607592', 'barquette_opaque', 0.37605295, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484489_0.png'] photo_id : 1333607593 output[photo_id] : [('1333607593', 'barquette_opaque', 0.6226455, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484490_0.png'] photo_id : 1333607594 output[photo_id] : [('1333607594', 'metal', 0.6394307, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484502_0.png'] photo_id : 1333607595 output[photo_id] : [('1333607595', 'barquette_opaque', 0.265152, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484521_0.png'] photo_id : 1333607596 output[photo_id] : [('1333607596', 'pet_fonce', 0.18094942, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484512_0.png'] photo_id : 1333607597 output[photo_id] : [('1333607597', 'film_plastique', 0.964193, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484524_0.png'] photo_id : 1333607598 output[photo_id] : [('1333607598', 'pet_clair', 0.3214906, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484541_0.png'] photo_id : 1333607629 output[photo_id] : [('1333607629', 'papier', 0.631595, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484446_0.png'] photo_id : 1333607630 output[photo_id] : [('1333607630', 'barquette_opaque', 0.8203922, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484440_0.png'] photo_id : 1333607631 output[photo_id] : [('1333607631', 'pet_opaque', 0.8398091, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484438_0.png'] photo_id : 1333607632 output[photo_id] : [('1333607632', 'etiquette', 0.87002593, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484433_0.png'] photo_id : 1333607633 output[photo_id] : [('1333607633', 'barquette_opaque', 0.6646403, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484482_0.png'] photo_id : 1333607634 output[photo_id] : [('1333607634', 'papier', 0.5403344, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484474_0.png'] photo_id : 1333607635 output[photo_id] : [('1333607635', 'papier', 0.71845704, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484463_0.png'] photo_id : 1333607636 output[photo_id] : [('1333607636', 'papier', 0.770218, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484471_0.png'] photo_id : 1333607637 output[photo_id] : [('1333607637', 'barquette_opaque', 0.8165969, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484472_0.png'] photo_id : 1333607638 output[photo_id] : [('1333607638', 'barquette_opaque', 0.48140913, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484468_0.png'] photo_id : 1333607639 output[photo_id] : [('1333607639', 'barquette_opaque', 0.86949986, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484473_0.png'] photo_id : 1333607640 output[photo_id] : [('1333607640', 'barquette_opaque', 0.833184, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484466_0.png'] photo_id : 1333607641 output[photo_id] : [('1333607641', 'barquette_opaque', 0.93632805, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484459_0.png'] photo_id : 1333607642 output[photo_id] : [('1333607642', 'papier', 0.6142729, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484497_0.png'] photo_id : 1333607643 output[photo_id] : [('1333607643', 'pet_opaque', 0.6646434, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484519_0.png'] photo_id : 1333607644 output[photo_id] : [('1333607644', 'barquette_opaque', 0.7294154, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484503_0.png'] photo_id : 1333607645 output[photo_id] : [('1333607645', 'papier', 0.85034865, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484516_0.png'] photo_id : 1333607646 output[photo_id] : [('1333607646', 'etiquette', 0.32839, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484504_0.png'] photo_id : 1333607647 output[photo_id] : [('1333607647', 'barquette_opaque', 0.99779165, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484499_0.png'] photo_id : 1333607648 output[photo_id] : [('1333607648', 'barquette_opaque', 0.9530963, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484501_0.png'] photo_id : 1333607649 output[photo_id] : [('1333607649', 'pet_opaque', 0.4143706, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484520_0.png'] photo_id : 1333607650 output[photo_id] : [('1333607650', 'carton', 0.3892123, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484535_0.png'] photo_id : 1333607651 output[photo_id] : [('1333607651', 'etiquette', 0.66388816, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484547_0.png'] photo_id : 1333607357 output[photo_id] : [('1333607357', 'barquette_opaque', 0.9279091, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3648358058_0.png'] photo_id : 1333607358 output[photo_id] : [('1333607358', 'barquette_opaque', 0.53552985, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484600_0.png'] photo_id : 1333607359 output[photo_id] : [('1333607359', 'barquette_opaque', 0.90756905, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484592_0.png'] photo_id : 1333607360 output[photo_id] : [('1333607360', 'textiles_sanitaires', 0.2482263, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484604_0.png'] photo_id : 1333607361 output[photo_id] : [('1333607361', 'film_plastique', 0.76690525, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3648358064_0.png'] photo_id : 1333607362 output[photo_id] : [('1333607362', 'film_plastique', 0.2619855, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484683_0.png'] photo_id : 1333607363 output[photo_id] : [('1333607363', 'barquette_opaque', 0.96422446, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484682_0.png'] photo_id : 1333607364 output[photo_id] : [('1333607364', 'barquette_opaque', 0.60549444, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484697_0.png'] photo_id : 1333607365 output[photo_id] : [('1333607365', 'barquette_opaque', 0.9053072, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484665_0.png'] photo_id : 1333607366 output[photo_id] : [('1333607366', 'barquette_opaque', 0.7527303, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484676_0.png'] photo_id : 1333607367 output[photo_id] : [('1333607367', 'film_plastique', 0.26718515, 4151, '3233'), 'temp/1738384468_3330313_1330289644_76235ac342d570f56fec45501044ab95_rle_crop_3626484671_0.png'] photo_id : 1333607370 output[photo_id] : [('1333607370', 'papier', 0.34747812, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484418_0.png'] photo_id : 1333607371 output[photo_id] : [('1333607371', 'carton', 0.7771504, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484412_0.png'] photo_id : 1333607372 output[photo_id] : [('1333607372', 'pet_opaque', 0.7063965, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484425_0.png'] photo_id : 1333607373 output[photo_id] : [('1333607373', 'barquette_opaque', 0.47535953, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484450_0.png'] photo_id : 1333607374 output[photo_id] : [('1333607374', 'etiquette', 0.7804115, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484506_0.png'] photo_id : 1333607375 output[photo_id] : [('1333607375', 'barquette_opaque', 0.8117867, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484545_0.png'] photo_id : 1333607376 output[photo_id] : [('1333607376', 'barquette_opaque', 0.2993486, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484552_0.png'] photo_id : 1333607377 output[photo_id] : [('1333607377', 'carton', 0.46677113, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484621_0.png'] photo_id : 1333607378 output[photo_id] : [('1333607378', 'carton', 0.9661687, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484620_0.png'] photo_id : 1333607379 output[photo_id] : [('1333607379', 'metal', 0.78756225, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484610_0.png'] photo_id : 1333607380 output[photo_id] : [('1333607380', 'papier', 0.37381402, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484602_0.png'] photo_id : 1333607381 output[photo_id] : [('1333607381', 'papier', 0.96077055, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3648358062_0.png'] photo_id : 1333607599 output[photo_id] : [('1333607599', 'film_plastique', 0.33606988, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484532_0.png'] photo_id : 1333607600 output[photo_id] : [('1333607600', 'pet_clair', 0.29720291, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484550_0.png'] photo_id : 1333607601 output[photo_id] : [('1333607601', 'barquette_opaque', 0.966984, 4151, '3233'), 'temp/1738384468_3330313_1330289652_e7fa8ab7a03cd37766698452abd8d48f_rle_crop_3626484574_0.png'] photo_id : 1333607602 output[photo_id] : [('1333607602', 'papier', 0.539365, 4151, '3233'), 'temp/1738384468_3330313_1330289652_e7fa8ab7a03cd37766698452abd8d48f_rle_crop_3648358050_0.png'] photo_id : 1333607603 output[photo_id] : [('1333607603', 'metal', 0.96185726, 4151, '3233'), 'temp/1738384468_3330313_1330289652_e7fa8ab7a03cd37766698452abd8d48f_rle_crop_3626484567_0.png'] photo_id : 1333607604 output[photo_id] : [('1333607604', 'papier', 0.42240158, 4151, '3233'), 'temp/1738384468_3330313_1330289652_e7fa8ab7a03cd37766698452abd8d48f_rle_crop_3648358054_0.png'] photo_id : 1333607605 output[photo_id] : [('1333607605', 'barquette_opaque', 0.39308107, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484612_0.png'] photo_id : 1333607606 output[photo_id] : [('1333607606', 'etiquette', 0.25206646, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484625_0.png'] photo_id : 1333607607 output[photo_id] : [('1333607607', 'papier', 0.63990146, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484658_0.png'] photo_id : 1333607608 output[photo_id] : [('1333607608', 'etiquette', 0.5243081, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484639_0.png'] photo_id : 1333607610 output[photo_id] : [('1333607610', 'barquette_opaque', 0.7019976, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484653_0.png'] photo_id : 1333607611 output[photo_id] : [('1333607611', 'barquette_opaque', 0.45253208, 4151, '3233'), 'temp/1738384468_3330313_1330289646_5799886aa6b9a8421ce66497bc2c6cd6_rle_crop_3626484634_0.png'] photo_id : 1333607618 output[photo_id] : [('1333607618', 'papier', 0.9578828, 4151, '3233'), 'temp/1738384468_3330313_1330289704_055f7d562f55bd353e82ba1c69b0e7cc_rle_crop_3648358045_0.png'] photo_id : 1333607619 output[photo_id] : [('1333607619', 'barquette_opaque', 0.8726515, 4151, '3233'), 'temp/1738384468_3330313_1330289704_055f7d562f55bd353e82ba1c69b0e7cc_rle_crop_3626484385_0.png'] photo_id : 1333607620 output[photo_id] : [('1333607620', 'etiquette', 0.532119, 4151, '3233'), 'temp/1738384468_3330313_1330289704_055f7d562f55bd353e82ba1c69b0e7cc_rle_crop_3626484366_0.png'] photo_id : 1333607621 output[photo_id] : [('1333607621', 'barquette_opaque', 0.9852668, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484396_0.png'] photo_id : 1333607622 output[photo_id] : [('1333607622', 'barquette_opaque', 0.4776309, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484414_0.png'] photo_id : 1333607623 output[photo_id] : [('1333607623', 'pet_opaque', 0.9897363, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484403_0.png'] photo_id : 1333607624 output[photo_id] : [('1333607624', 'barquette_opaque', 0.9084373, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484416_0.png'] photo_id : 1333607625 output[photo_id] : [('1333607625', 'barquette_opaque', 0.9508184, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484411_0.png'] photo_id : 1333607626 output[photo_id] : [('1333607626', 'barquette_opaque', 0.6359178, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484437_0.png'] photo_id : 1333607627 output[photo_id] : [('1333607627', 'pet_fonce', 0.37749085, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484456_0.png'] photo_id : 1333607628 output[photo_id] : [('1333607628', 'barquette_opaque', 0.45872733, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484424_0.png'] photo_id : 1333607334 output[photo_id] : [('1333607334', 'film_plastique', 0.6056497, 4151, '3233'), 'temp/1738384468_3330313_1330289704_055f7d562f55bd353e82ba1c69b0e7cc_rle_crop_3626484367_0.png'] photo_id : 1333607335 output[photo_id] : [('1333607335', 'barquette_opaque', 0.39940733, 4151, '3233'), 'temp/1738384468_3330313_1330289704_055f7d562f55bd353e82ba1c69b0e7cc_rle_crop_3648358044_0.png'] photo_id : 1333607336 output[photo_id] : [('1333607336', 'pet_clair', 0.41664237, 4151, '3233'), 'temp/1738384468_3330313_1330289704_055f7d562f55bd353e82ba1c69b0e7cc_rle_crop_3626484387_0.png'] photo_id : 1333607337 output[photo_id] : [('1333607337', 'papier', 0.5642238, 4151, '3233'), 'temp/1738384468_3330313_1330289704_055f7d562f55bd353e82ba1c69b0e7cc_rle_crop_3626484379_0.png'] photo_id : 1333607338 output[photo_id] : [('1333607338', 'pet_clair', 0.23254508, 4151, '3233'), 'temp/1738384468_3330313_1330289704_055f7d562f55bd353e82ba1c69b0e7cc_rle_crop_3626484381_0.png'] photo_id : 1333607339 output[photo_id] : [('1333607339', 'papier', 0.6836088, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484415_0.png'] photo_id : 1333607340 output[photo_id] : [('1333607340', 'pet_clair', 0.5299266, 4151, '3233'), 'temp/1738384468_3330313_1330289697_1b0af7e43504234e4cf8a4366e095028_rle_crop_3626484410_0.png'] photo_id : 1333607341 output[photo_id] : [('1333607341', 'barquette_opaque', 0.79713166, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484441_0.png'] photo_id : 1333607342 output[photo_id] : [('1333607342', 'barquette_opaque', 0.5176734, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484429_0.png'] photo_id : 1333607343 output[photo_id] : [('1333607343', 'pet_opaque', 0.8010424, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484455_0.png'] photo_id : 1333607344 output[photo_id] : [('1333607344', 'barquette_opaque', 0.99538934, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484436_0.png'] photo_id : 1333607345 output[photo_id] : [('1333607345', 'barquette_opaque', 0.9754346, 4151, '3233'), 'temp/1738384468_3330313_1330289693_1b57a9ee2705a0db54393912bc81da41_rle_crop_3626484442_0.png'] photo_id : 1333607346 output[photo_id] : [('1333607346', 'barquette_opaque', 0.8298495, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484481_0.png'] photo_id : 1333607347 output[photo_id] : [('1333607347', 'barquette_opaque', 0.33474353, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484491_0.png'] photo_id : 1333607348 output[photo_id] : [('1333607348', 'barquette_opaque', 0.3234359, 4151, '3233'), 'temp/1738384468_3330313_1330289691_9aacb678dcd3df9f3c26a1f0d630b3b9_rle_crop_3626484480_0.png'] photo_id : 1333607349 output[photo_id] : [('1333607349', 'etiquette', 0.4364067, 4151, '3233'), 'temp/1738384468_3330313_1330289663_3a3b4a33afb88b94bae38aa024bb5a4d_rle_crop_3626484514_0.png'] photo_id : 1333607350 output[photo_id] : [('1333607350', 'pet_clair', 0.8154706, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484542_0.png'] photo_id : 1333607351 output[photo_id] : [('1333607351', 'film_plastique', 0.6928934, 4151, '3233'), 'temp/1738384468_3330313_1330289661_a85874ea1c6ff87fb496b5d94c043388_rle_crop_3626484525_0.png'] photo_id : 1333607352 output[photo_id] : [('1333607352', 'barquette_opaque', 0.9811323, 4151, '3233'), 'temp/1738384468_3330313_1330289652_e7fa8ab7a03cd37766698452abd8d48f_rle_crop_3626484560_0.png'] photo_id : 1333607353 output[photo_id] : [('1333607353', 'pet_clair', 0.28156152, 4151, '3233'), 'temp/1738384468_3330313_1330289652_e7fa8ab7a03cd37766698452abd8d48f_rle_crop_3626484555_0.png'] photo_id : 1333607354 output[photo_id] : [('1333607354', 'film_plastique', 0.3448444, 4151, '3233'), 'temp/1738384468_3330313_1330289652_e7fa8ab7a03cd37766698452abd8d48f_rle_crop_3626484566_0.png'] photo_id : 1333607355 output[photo_id] : [('1333607355', 'barquette_opaque', 0.45484662, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484617_0.png'] photo_id : 1333607356 output[photo_id] : [('1333607356', 'papier', 0.37947875, 4151, '3233'), 'temp/1738384468_3330313_1330289649_e679ab2eb26ba3f7449488db9e480a70_rle_crop_3626484588_0.png'] begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 229 time used for this insertion : 0.47839975357055664 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 229 time used for this insertion : 0.02530050277709961 save missing photos in datou_result : time spend for datou_step_exec : 0.003194570541381836 time spend to save output : 0.5071101188659668 total time spend for step 6 : 0.5103046894073486 step7:merge_mask_thcl_custom Sat Feb 1 05:38:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step merge_mask_thcl_custom this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it batch 1 Loaded 358 chid ids of type : 3760 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++As expected we have just one thcl present begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : batch 1 Loaded 229 chid ids of type : 4210 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 229 chid ids of type : 4210 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++End of step merge_mask_thcl_custom Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : merge_mask_thcl_custom we use saveGeneral [1330289704, 1330289697, 1330289693, 1330289691, 1330289663, 1330289661, 1330289652, 1330289649, 1330289646, 1330289644] Looping around the photos to save general results len do output : 10 /1330289704Didn't retrieve data .Didn't retrieve data . /1330289697Didn't retrieve data .Didn't retrieve data . /1330289693Didn't retrieve data .Didn't retrieve data . /1330289691Didn't retrieve data .Didn't retrieve data . /1330289663Didn't retrieve data .Didn't retrieve data . /1330289661Didn't retrieve data .Didn't retrieve data . /1330289652Didn't retrieve data .Didn't retrieve data . /1330289649Didn't retrieve data .Didn't retrieve data . /1330289646Didn't retrieve data .Didn't retrieve data . /1330289644Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289704', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289697', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289693', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289691', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289663', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289661', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289652', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289649', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289646', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289644', None, None, None, None, None, '2533517') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.02335190773010254 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.4154250621795654 time spend to save output : 0.023897171020507812 total time spend for step 7 : 1.4393222332000732 step8:rle_unique_nms_with_priority Sat Feb 1 05:38:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms nb_obj : 16 nb_hashtags : 8 time to prepare the origin masks : 3.106715202331543 time for calcul the mask position with numpy : 0.20005321502685547 nb_pixel_total : 1829932 time to create 1 rle with new method : 0.14890551567077637 time for calcul the mask position with numpy : 0.006478071212768555 nb_pixel_total : 17884 time to create 1 rle with old method : 0.019206523895263672 time for calcul the mask position with numpy : 0.006078481674194336 nb_pixel_total : 601 time to create 1 rle with old method : 0.0008127689361572266 time for calcul the mask position with numpy : 0.006105661392211914 nb_pixel_total : 27 time to create 1 rle with old method : 0.0001780986785888672 time for calcul the mask position with numpy : 0.006407737731933594 nb_pixel_total : 8130 time to create 1 rle with old method : 0.008709192276000977 time for calcul the mask position with numpy : 0.006178379058837891 nb_pixel_total : 6834 time to create 1 rle with old method : 0.007422924041748047 time for calcul the mask position with numpy : 0.006612539291381836 nb_pixel_total : 14040 time to create 1 rle with old method : 0.015500783920288086 time for calcul the mask position with numpy : 0.006595611572265625 nb_pixel_total : 23489 time to create 1 rle with old method : 0.025610923767089844 time for calcul the mask position with numpy : 0.006424427032470703 nb_pixel_total : 6650 time to create 1 rle with old method : 0.007465839385986328 time for calcul the mask position with numpy : 0.006291627883911133 nb_pixel_total : 11478 time to create 1 rle with old method : 0.012728691101074219 time for calcul the mask position with numpy : 0.0064983367919921875 nb_pixel_total : 20090 time to create 1 rle with old method : 0.022392749786376953 time for calcul the mask position with numpy : 0.007302999496459961 nb_pixel_total : 3734 time to create 1 rle with old method : 0.004241943359375 time for calcul the mask position with numpy : 0.008189201354980469 nb_pixel_total : 13887 time to create 1 rle with old method : 0.015537261962890625 time for calcul the mask position with numpy : 0.007294654846191406 nb_pixel_total : 85920 time to create 1 rle with old method : 0.09279036521911621 time for calcul the mask position with numpy : 0.00612640380859375 nb_pixel_total : 11880 time to create 1 rle with old method : 0.012869119644165039 time for calcul the mask position with numpy : 0.005941629409790039 nb_pixel_total : 3431 time to create 1 rle with old method : 0.003641843795776367 time for calcul the mask position with numpy : 0.006060123443603516 nb_pixel_total : 15593 time to create 1 rle with old method : 0.0168759822845459 create new chi : 0.7296051979064941 time to delete rle : 0.04894566535949707 batch 1 Loaded 32 chid ids of type : 4211 Number RLEs to save : 5392 TO DO : save crop sub photo not yet done ! save time : 2.1542441844940186 nb_obj : 24 nb_hashtags : 8 time to prepare the origin masks : 2.4943923950195312 time for calcul the mask position with numpy : 0.1105508804321289 nb_pixel_total : 1856409 time to create 1 rle with new method : 0.16134166717529297 time for calcul the mask position with numpy : 0.006200313568115234 nb_pixel_total : 628 time to create 1 rle with old method : 0.0008492469787597656 time for calcul the mask position with numpy : 0.006051540374755859 nb_pixel_total : 7676 time to create 1 rle with old method : 0.008667707443237305 time for calcul the mask position with numpy : 0.005684614181518555 nb_pixel_total : 5177 time to create 1 rle with old method : 0.0052645206451416016 time for calcul the mask position with numpy : 0.005700588226318359 nb_pixel_total : 8682 time to create 1 rle with old method : 0.009150266647338867 time for calcul the mask position with numpy : 0.005761861801147461 nb_pixel_total : 5730 time to create 1 rle with old method : 0.0059664249420166016 time for calcul the mask position with numpy : 0.005998849868774414 nb_pixel_total : 5776 time to create 1 rle with old method : 0.006123542785644531 time for calcul the mask position with numpy : 0.0061070919036865234 nb_pixel_total : 3641 time to create 1 rle with old method : 0.00404667854309082 time for calcul the mask position with numpy : 0.00625157356262207 nb_pixel_total : 18701 time to create 1 rle with old method : 0.02049422264099121 time for calcul the mask position with numpy : 0.005984783172607422 nb_pixel_total : 9930 time to create 1 rle with old method : 0.010756254196166992 time for calcul the mask position with numpy : 0.0060770511627197266 nb_pixel_total : 9088 time to create 1 rle with old method : 0.010013103485107422 time for calcul the mask position with numpy : 0.006101369857788086 nb_pixel_total : 15953 time to create 1 rle with old method : 0.016843557357788086 time for calcul the mask position with numpy : 0.006203889846801758 nb_pixel_total : 16376 time to create 1 rle with old method : 0.017374277114868164 time for calcul the mask position with numpy : 0.006273984909057617 nb_pixel_total : 21872 time to create 1 rle with old method : 0.02335524559020996 time for calcul the mask position with numpy : 0.005889892578125 nb_pixel_total : 12674 time to create 1 rle with old method : 0.01346588134765625 time for calcul the mask position with numpy : 0.0058176517486572266 nb_pixel_total : 3544 time to create 1 rle with old method : 0.0037386417388916016 time for calcul the mask position with numpy : 0.005948543548583984 nb_pixel_total : 6331 time to create 1 rle with old method : 0.007051229476928711 time for calcul the mask position with numpy : 0.005943775177001953 nb_pixel_total : 3106 time to create 1 rle with old method : 0.003538370132446289 time for calcul the mask position with numpy : 0.006100893020629883 nb_pixel_total : 9673 time to create 1 rle with old method : 0.010760307312011719 time for calcul the mask position with numpy : 0.006094217300415039 nb_pixel_total : 11463 time to create 1 rle with old method : 0.012456893920898438 time for calcul the mask position with numpy : 0.0058917999267578125 nb_pixel_total : 1444 time to create 1 rle with old method : 0.0015995502471923828 time for calcul the mask position with numpy : 0.0059053897857666016 nb_pixel_total : 11976 time to create 1 rle with old method : 0.012801885604858398 time for calcul the mask position with numpy : 0.0060231685638427734 nb_pixel_total : 9599 time to create 1 rle with old method : 0.010572195053100586 time for calcul the mask position with numpy : 0.006131410598754883 nb_pixel_total : 5044 time to create 1 rle with old method : 0.005669355392456055 time for calcul the mask position with numpy : 0.0061533451080322266 nb_pixel_total : 13107 time to create 1 rle with old method : 0.014545202255249023 create new chi : 0.6616003513336182 time to delete rle : 0.0006928443908691406 batch 1 Loaded 49 chid ids of type : 4211 Number RLEs to save : 6967 TO DO : save crop sub photo not yet done ! save time : 1.776181697845459 nb_obj : 23 nb_hashtags : 6 time to prepare the origin masks : 1.2916734218597412 time for calcul the mask position with numpy : 0.018433332443237305 nb_pixel_total : 1829485 time to create 1 rle with new method : 0.1686553955078125 time for calcul the mask position with numpy : 0.005778312683105469 nb_pixel_total : 2517 time to create 1 rle with old method : 0.0026731491088867188 time for calcul the mask position with numpy : 0.005736589431762695 nb_pixel_total : 6202 time to create 1 rle with old method : 0.006348371505737305 time for calcul the mask position with numpy : 0.005777835845947266 nb_pixel_total : 21366 time to create 1 rle with old method : 0.022613048553466797 time for calcul the mask position with numpy : 0.005873441696166992 nb_pixel_total : 8720 time to create 1 rle with old method : 0.009236335754394531 time for calcul the mask position with numpy : 0.005753993988037109 nb_pixel_total : 10318 time to create 1 rle with old method : 0.010573387145996094 time for calcul the mask position with numpy : 0.005614280700683594 nb_pixel_total : 3581 time to create 1 rle with old method : 0.003708362579345703 time for calcul the mask position with numpy : 0.005710601806640625 nb_pixel_total : 7029 time to create 1 rle with old method : 0.007348299026489258 time for calcul the mask position with numpy : 0.005817413330078125 nb_pixel_total : 6282 time to create 1 rle with old method : 0.006731986999511719 time for calcul the mask position with numpy : 0.005869626998901367 nb_pixel_total : 11050 time to create 1 rle with old method : 0.012184858322143555 time for calcul the mask position with numpy : 0.0058689117431640625 nb_pixel_total : 3482 time to create 1 rle with old method : 0.0037512779235839844 time for calcul the mask position with numpy : 0.005908966064453125 nb_pixel_total : 5218 time to create 1 rle with old method : 0.00587153434753418 time for calcul the mask position with numpy : 0.006072998046875 nb_pixel_total : 7832 time to create 1 rle with old method : 0.008627891540527344 time for calcul the mask position with numpy : 0.005901813507080078 nb_pixel_total : 5811 time to create 1 rle with old method : 0.00632929801940918 time for calcul the mask position with numpy : 0.006016969680786133 nb_pixel_total : 2914 time to create 1 rle with old method : 0.0032927989959716797 time for calcul the mask position with numpy : 0.006136655807495117 nb_pixel_total : 4482 time to create 1 rle with old method : 0.005098819732666016 time for calcul the mask position with numpy : 0.0061643123626708984 nb_pixel_total : 15183 time to create 1 rle with old method : 0.016458749771118164 time for calcul the mask position with numpy : 0.005952119827270508 nb_pixel_total : 23592 time to create 1 rle with old method : 0.025097131729125977 time for calcul the mask position with numpy : 0.00592041015625 nb_pixel_total : 7721 time to create 1 rle with old method : 0.008038759231567383 time for calcul the mask position with numpy : 0.005942821502685547 nb_pixel_total : 25959 time to create 1 rle with old method : 0.02739262580871582 time for calcul the mask position with numpy : 0.005921840667724609 nb_pixel_total : 2774 time to create 1 rle with old method : 0.0030145645141601562 time for calcul the mask position with numpy : 0.006061553955078125 nb_pixel_total : 5417 time to create 1 rle with old method : 0.005687713623046875 time for calcul the mask position with numpy : 0.006359100341796875 nb_pixel_total : 29431 time to create 1 rle with old method : 0.030985116958618164 time for calcul the mask position with numpy : 0.006039857864379883 nb_pixel_total : 27234 time to create 1 rle with old method : 0.02845311164855957 create new chi : 0.589897871017456 time to delete rle : 0.0006361007690429688 batch 1 Loaded 47 chid ids of type : 4211 Number RLEs to save : 6825 TO DO : save crop sub photo not yet done ! save time : 6.210210561752319 nb_obj : 25 nb_hashtags : 6 time to prepare the origin masks : 1.9901838302612305 time for calcul the mask position with numpy : 0.05167531967163086 nb_pixel_total : 1816096 time to create 1 rle with new method : 0.29071664810180664 time for calcul the mask position with numpy : 0.006594181060791016 nb_pixel_total : 1936 time to create 1 rle with old method : 0.0023126602172851562 time for calcul the mask position with numpy : 0.006726264953613281 nb_pixel_total : 19390 time to create 1 rle with old method : 0.021141767501831055 time for calcul the mask position with numpy : 0.006930828094482422 nb_pixel_total : 6129 time to create 1 rle with old method : 0.00977182388305664 time for calcul the mask position with numpy : 0.0070111751556396484 nb_pixel_total : 6266 time to create 1 rle with old method : 0.010211944580078125 time for calcul the mask position with numpy : 0.006798505783081055 nb_pixel_total : 8911 time to create 1 rle with old method : 0.014143705368041992 time for calcul the mask position with numpy : 0.008004903793334961 nb_pixel_total : 3921 time to create 1 rle with old method : 0.00783538818359375 time for calcul the mask position with numpy : 0.009302139282226562 nb_pixel_total : 3868 time to create 1 rle with old method : 0.005995750427246094 time for calcul the mask position with numpy : 0.006254911422729492 nb_pixel_total : 3210 time to create 1 rle with old method : 0.0035660266876220703 time for calcul the mask position with numpy : 0.006222248077392578 nb_pixel_total : 5908 time to create 1 rle with old method : 0.006705284118652344 time for calcul the mask position with numpy : 0.006100893020629883 nb_pixel_total : 6606 time to create 1 rle with old method : 0.007433414459228516 time for calcul the mask position with numpy : 0.0062296390533447266 nb_pixel_total : 6266 time to create 1 rle with old method : 0.007064104080200195 time for calcul the mask position with numpy : 0.006574869155883789 nb_pixel_total : 5928 time to create 1 rle with old method : 0.00651097297668457 time for calcul the mask position with numpy : 0.006783008575439453 nb_pixel_total : 53764 time to create 1 rle with old method : 0.06079459190368652 time for calcul the mask position with numpy : 0.0063304901123046875 nb_pixel_total : 6786 time to create 1 rle with old method : 0.008209943771362305 time for calcul the mask position with numpy : 0.0060498714447021484 nb_pixel_total : 4573 time to create 1 rle with old method : 0.005712270736694336 time for calcul the mask position with numpy : 0.006064891815185547 nb_pixel_total : 8399 time to create 1 rle with old method : 0.010076045989990234 time for calcul the mask position with numpy : 0.006152153015136719 nb_pixel_total : 4817 time to create 1 rle with old method : 0.005869388580322266 time for calcul the mask position with numpy : 0.0064716339111328125 nb_pixel_total : 6580 time to create 1 rle with old method : 0.011395692825317383 time for calcul the mask position with numpy : 0.00651860237121582 nb_pixel_total : 4230 time to create 1 rle with old method : 0.005102872848510742 time for calcul the mask position with numpy : 0.006237983703613281 nb_pixel_total : 14429 time to create 1 rle with old method : 0.017156600952148438 time for calcul the mask position with numpy : 0.006289958953857422 nb_pixel_total : 18248 time to create 1 rle with old method : 0.02878546714782715 time for calcul the mask position with numpy : 0.006704568862915039 nb_pixel_total : 21089 time to create 1 rle with old method : 0.033487558364868164 time for calcul the mask position with numpy : 0.007134437561035156 nb_pixel_total : 10159 time to create 1 rle with old method : 0.011596441268920898 time for calcul the mask position with numpy : 0.0062487125396728516 nb_pixel_total : 6953 time to create 1 rle with old method : 0.007675886154174805 time for calcul the mask position with numpy : 0.006116151809692383 nb_pixel_total : 19138 time to create 1 rle with old method : 0.020961999893188477 create new chi : 0.8500652313232422 time to delete rle : 0.0006906986236572266 batch 1 Loaded 51 chid ids of type : 4211 Number RLEs to save : 6953 TO DO : save crop sub photo not yet done ! save time : 3.587738037109375 nb_obj : 21 nb_hashtags : 7 time to prepare the origin masks : 1.2873291969299316 time for calcul the mask position with numpy : 0.018195152282714844 nb_pixel_total : 1866244 time to create 1 rle with new method : 0.07239866256713867 time for calcul the mask position with numpy : 0.005984306335449219 nb_pixel_total : 9498 time to create 1 rle with old method : 0.010351896286010742 time for calcul the mask position with numpy : 0.005739927291870117 nb_pixel_total : 10380 time to create 1 rle with old method : 0.010630607604980469 time for calcul the mask position with numpy : 0.005710124969482422 nb_pixel_total : 13384 time to create 1 rle with old method : 0.01439213752746582 time for calcul the mask position with numpy : 0.00588679313659668 nb_pixel_total : 15257 time to create 1 rle with old method : 0.016678571701049805 time for calcul the mask position with numpy : 0.0062601566314697266 nb_pixel_total : 6040 time to create 1 rle with old method : 0.006700754165649414 time for calcul the mask position with numpy : 0.005876779556274414 nb_pixel_total : 12996 time to create 1 rle with old method : 0.019173383712768555 time for calcul the mask position with numpy : 0.007024526596069336 nb_pixel_total : 12907 time to create 1 rle with old method : 0.020610570907592773 time for calcul the mask position with numpy : 0.006537914276123047 nb_pixel_total : 5209 time to create 1 rle with old method : 0.008487462997436523 time for calcul the mask position with numpy : 0.0066471099853515625 nb_pixel_total : 3246 time to create 1 rle with old method : 0.005293130874633789 time for calcul the mask position with numpy : 0.006643533706665039 nb_pixel_total : 7228 time to create 1 rle with old method : 0.008487701416015625 time for calcul the mask position with numpy : 0.006308317184448242 nb_pixel_total : 7035 time to create 1 rle with old method : 0.007849931716918945 time for calcul the mask position with numpy : 0.006212711334228516 nb_pixel_total : 14289 time to create 1 rle with old method : 0.015409469604492188 time for calcul the mask position with numpy : 0.006178855895996094 nb_pixel_total : 5015 time to create 1 rle with old method : 0.005633831024169922 time for calcul the mask position with numpy : 0.00593876838684082 nb_pixel_total : 3049 time to create 1 rle with old method : 0.003379344940185547 time for calcul the mask position with numpy : 0.0060214996337890625 nb_pixel_total : 14135 time to create 1 rle with old method : 0.015381574630737305 time for calcul the mask position with numpy : 0.006038188934326172 nb_pixel_total : 2879 time to create 1 rle with old method : 0.0030150413513183594 time for calcul the mask position with numpy : 0.006033658981323242 nb_pixel_total : 5946 time to create 1 rle with old method : 0.0063381195068359375 time for calcul the mask position with numpy : 0.006051063537597656 nb_pixel_total : 12132 time to create 1 rle with old method : 0.012944221496582031 time for calcul the mask position with numpy : 0.006106376647949219 nb_pixel_total : 20932 time to create 1 rle with old method : 0.0223391056060791 time for calcul the mask position with numpy : 0.006188392639160156 nb_pixel_total : 5025 time to create 1 rle with old method : 0.005582332611083984 time for calcul the mask position with numpy : 0.006513833999633789 nb_pixel_total : 20774 time to create 1 rle with old method : 0.023050546646118164 create new chi : 0.47014617919921875 time to delete rle : 0.0006792545318603516 batch 1 Loaded 43 chid ids of type : 4211 Number RLEs to save : 6327 TO DO : save crop sub photo not yet done ! save time : 1.9547944068908691 nb_obj : 23 nb_hashtags : 9 time to prepare the origin masks : 2.3539090156555176 time for calcul the mask position with numpy : 0.14492321014404297 nb_pixel_total : 1870768 time to create 1 rle with new method : 0.21296000480651855 time for calcul the mask position with numpy : 0.0061991214752197266 nb_pixel_total : 1284 time to create 1 rle with old method : 0.0014545917510986328 time for calcul the mask position with numpy : 0.006008148193359375 nb_pixel_total : 12217 time to create 1 rle with old method : 0.013417720794677734 time for calcul the mask position with numpy : 0.0060443878173828125 nb_pixel_total : 6358 time to create 1 rle with old method : 0.0070612430572509766 time for calcul the mask position with numpy : 0.005988121032714844 nb_pixel_total : 8316 time to create 1 rle with old method : 0.009081125259399414 time for calcul the mask position with numpy : 0.005898714065551758 nb_pixel_total : 7483 time to create 1 rle with old method : 0.00828242301940918 time for calcul the mask position with numpy : 0.0061452388763427734 nb_pixel_total : 7885 time to create 1 rle with old method : 0.00866842269897461 time for calcul the mask position with numpy : 0.006575822830200195 nb_pixel_total : 3830 time to create 1 rle with old method : 0.004223346710205078 time for calcul the mask position with numpy : 0.006009817123413086 nb_pixel_total : 6273 time to create 1 rle with old method : 0.006857395172119141 time for calcul the mask position with numpy : 0.00609135627746582 nb_pixel_total : 5727 time to create 1 rle with old method : 0.0066492557525634766 time for calcul the mask position with numpy : 0.006085872650146484 nb_pixel_total : 8279 time to create 1 rle with old method : 0.008944988250732422 time for calcul the mask position with numpy : 0.0060749053955078125 nb_pixel_total : 10186 time to create 1 rle with old method : 0.011407613754272461 time for calcul the mask position with numpy : 0.006052732467651367 nb_pixel_total : 1975 time to create 1 rle with old method : 0.002225637435913086 time for calcul the mask position with numpy : 0.005898952484130859 nb_pixel_total : 1726 time to create 1 rle with old method : 0.0019452571868896484 time for calcul the mask position with numpy : 0.006009101867675781 nb_pixel_total : 9461 time to create 1 rle with old method : 0.010062217712402344 time for calcul the mask position with numpy : 0.006087064743041992 nb_pixel_total : 19034 time to create 1 rle with old method : 0.02001476287841797 time for calcul the mask position with numpy : 0.00610661506652832 nb_pixel_total : 26090 time to create 1 rle with old method : 0.02933049201965332 time for calcul the mask position with numpy : 0.006532430648803711 nb_pixel_total : 6732 time to create 1 rle with old method : 0.007795572280883789 time for calcul the mask position with numpy : 0.00637364387512207 nb_pixel_total : 18656 time to create 1 rle with old method : 0.02045726776123047 time for calcul the mask position with numpy : 0.0062160491943359375 nb_pixel_total : 11745 time to create 1 rle with old method : 0.012479066848754883 time for calcul the mask position with numpy : 0.005924224853515625 nb_pixel_total : 4877 time to create 1 rle with old method : 0.005086660385131836 time for calcul the mask position with numpy : 0.00627446174621582 nb_pixel_total : 3958 time to create 1 rle with old method : 0.0041463375091552734 time for calcul the mask position with numpy : 0.005954265594482422 nb_pixel_total : 5939 time to create 1 rle with old method : 0.006086587905883789 time for calcul the mask position with numpy : 0.006072282791137695 nb_pixel_total : 14801 time to create 1 rle with old method : 0.01612567901611328 create new chi : 0.7304637432098389 time to delete rle : 0.0007038116455078125 batch 1 Loaded 47 chid ids of type : 4211 Number RLEs to save : 6149 TO DO : save crop sub photo not yet done ! save time : 4.021151304244995 nb_obj : 20 nb_hashtags : 7 time to prepare the origin masks : 1.4207055568695068 time for calcul the mask position with numpy : 0.025077104568481445 nb_pixel_total : 1868332 time to create 1 rle with new method : 0.060346364974975586 time for calcul the mask position with numpy : 0.005794525146484375 nb_pixel_total : 14918 time to create 1 rle with old method : 0.016312599182128906 time for calcul the mask position with numpy : 0.006161689758300781 nb_pixel_total : 1750 time to create 1 rle with old method : 0.001966714859008789 time for calcul the mask position with numpy : 0.0058672428131103516 nb_pixel_total : 14890 time to create 1 rle with old method : 0.01609015464782715 time for calcul the mask position with numpy : 0.005787372589111328 nb_pixel_total : 7101 time to create 1 rle with old method : 0.00770115852355957 time for calcul the mask position with numpy : 0.009631633758544922 nb_pixel_total : 89 time to create 1 rle with old method : 0.00016832351684570312 time for calcul the mask position with numpy : 0.009945392608642578 nb_pixel_total : 10829 time to create 1 rle with old method : 0.011818408966064453 time for calcul the mask position with numpy : 0.0059528350830078125 nb_pixel_total : 6901 time to create 1 rle with old method : 0.0073299407958984375 time for calcul the mask position with numpy : 0.005989551544189453 nb_pixel_total : 4433 time to create 1 rle with old method : 0.004799604415893555 time for calcul the mask position with numpy : 0.005785465240478516 nb_pixel_total : 7548 time to create 1 rle with old method : 0.007848024368286133 time for calcul the mask position with numpy : 0.005850553512573242 nb_pixel_total : 10845 time to create 1 rle with old method : 0.012360572814941406 time for calcul the mask position with numpy : 0.007996797561645508 nb_pixel_total : 22933 time to create 1 rle with old method : 0.024981260299682617 time for calcul the mask position with numpy : 0.006022214889526367 nb_pixel_total : 7484 time to create 1 rle with old method : 0.00772404670715332 time for calcul the mask position with numpy : 0.005764961242675781 nb_pixel_total : 4388 time to create 1 rle with old method : 0.004767417907714844 time for calcul the mask position with numpy : 0.0063512325286865234 nb_pixel_total : 4527 time to create 1 rle with old method : 0.004994630813598633 time for calcul the mask position with numpy : 0.005852222442626953 nb_pixel_total : 7197 time to create 1 rle with old method : 0.007843017578125 time for calcul the mask position with numpy : 0.005978107452392578 nb_pixel_total : 22157 time to create 1 rle with old method : 0.023875951766967773 time for calcul the mask position with numpy : 0.005881309509277344 nb_pixel_total : 9427 time to create 1 rle with old method : 0.010010480880737305 time for calcul the mask position with numpy : 0.005852699279785156 nb_pixel_total : 25809 time to create 1 rle with old method : 0.026843786239624023 time for calcul the mask position with numpy : 0.005811452865600586 nb_pixel_total : 13217 time to create 1 rle with old method : 0.01434183120727539 time for calcul the mask position with numpy : 0.005975961685180664 nb_pixel_total : 8825 time to create 1 rle with old method : 0.009730100631713867 create new chi : 0.43637633323669434 time to delete rle : 0.0009477138519287109 batch 1 Loaded 41 chid ids of type : 4211 Number RLEs to save : 6397 TO DO : save crop sub photo not yet done ! save time : 4.041430473327637 nb_obj : 27 nb_hashtags : 7 time to prepare the origin masks : 3.1707963943481445 time for calcul the mask position with numpy : 0.24267196655273438 nb_pixel_total : 1747688 time to create 1 rle with new method : 0.17996501922607422 time for calcul the mask position with numpy : 0.006306648254394531 nb_pixel_total : 13342 time to create 1 rle with old method : 0.014687776565551758 time for calcul the mask position with numpy : 0.006047964096069336 nb_pixel_total : 1512 time to create 1 rle with old method : 0.0017025470733642578 time for calcul the mask position with numpy : 0.006010532379150391 nb_pixel_total : 8402 time to create 1 rle with old method : 0.009128332138061523 time for calcul the mask position with numpy : 0.0062825679779052734 nb_pixel_total : 31986 time to create 1 rle with old method : 0.034529685974121094 time for calcul the mask position with numpy : 0.006336688995361328 nb_pixel_total : 14709 time to create 1 rle with old method : 0.01607227325439453 time for calcul the mask position with numpy : 0.0061151981353759766 nb_pixel_total : 10485 time to create 1 rle with old method : 0.011226415634155273 time for calcul the mask position with numpy : 0.006344318389892578 nb_pixel_total : 25615 time to create 1 rle with old method : 0.02762889862060547 time for calcul the mask position with numpy : 0.006547212600708008 nb_pixel_total : 38525 time to create 1 rle with old method : 0.04155683517456055 time for calcul the mask position with numpy : 0.006003618240356445 nb_pixel_total : 5009 time to create 1 rle with old method : 0.005184173583984375 time for calcul the mask position with numpy : 0.006013631820678711 nb_pixel_total : 12228 time to create 1 rle with old method : 0.013993978500366211 time for calcul the mask position with numpy : 0.0061299800872802734 nb_pixel_total : 9778 time to create 1 rle with old method : 0.009960412979125977 time for calcul the mask position with numpy : 0.005927085876464844 nb_pixel_total : 4102 time to create 1 rle with old method : 0.004206180572509766 time for calcul the mask position with numpy : 0.005974769592285156 nb_pixel_total : 20018 time to create 1 rle with old method : 0.02146458625793457 time for calcul the mask position with numpy : 0.006143093109130859 nb_pixel_total : 16801 time to create 1 rle with old method : 0.017930030822753906 time for calcul the mask position with numpy : 0.006091594696044922 nb_pixel_total : 28252 time to create 1 rle with old method : 0.03075385093688965 time for calcul the mask position with numpy : 0.006505727767944336 nb_pixel_total : 6780 time to create 1 rle with old method : 0.007369518280029297 time for calcul the mask position with numpy : 0.006186962127685547 nb_pixel_total : 8607 time to create 1 rle with old method : 0.009452581405639648 time for calcul the mask position with numpy : 0.00617218017578125 nb_pixel_total : 14670 time to create 1 rle with old method : 0.015361309051513672 time for calcul the mask position with numpy : 0.005881309509277344 nb_pixel_total : 8170 time to create 1 rle with old method : 0.008534908294677734 time for calcul the mask position with numpy : 0.006129026412963867 nb_pixel_total : 4089 time to create 1 rle with old method : 0.004207611083984375 time for calcul the mask position with numpy : 0.005853176116943359 nb_pixel_total : 10019 time to create 1 rle with old method : 0.010490894317626953 time for calcul the mask position with numpy : 0.005803823471069336 nb_pixel_total : 3254 time to create 1 rle with old method : 0.003455638885498047 time for calcul the mask position with numpy : 0.00574946403503418 nb_pixel_total : 5970 time to create 1 rle with old method : 0.0061604976654052734 time for calcul the mask position with numpy : 0.00627589225769043 nb_pixel_total : 10123 time to create 1 rle with old method : 0.01069951057434082 time for calcul the mask position with numpy : 0.005982637405395508 nb_pixel_total : 4885 time to create 1 rle with old method : 0.005285024642944336 time for calcul the mask position with numpy : 0.006041049957275391 nb_pixel_total : 4806 time to create 1 rle with old method : 0.004982471466064453 time for calcul the mask position with numpy : 0.008145570755004883 nb_pixel_total : 3775 time to create 1 rle with old method : 0.004019260406494141 create new chi : 0.9505009651184082 time to delete rle : 0.0008294582366943359 batch 1 Loaded 55 chid ids of type : 4211 Number RLEs to save : 9406 TO DO : save crop sub photo not yet done ! save time : 13.905078887939453 nb_obj : 24 nb_hashtags : 7 time to prepare the origin masks : 2.171506643295288 time for calcul the mask position with numpy : 0.023365020751953125 nb_pixel_total : 1807067 time to create 1 rle with new method : 0.1024315357208252 time for calcul the mask position with numpy : 0.009437322616577148 nb_pixel_total : 5853 time to create 1 rle with old method : 0.005927324295043945 time for calcul the mask position with numpy : 0.009203672409057617 nb_pixel_total : 4811 time to create 1 rle with old method : 0.005167722702026367 time for calcul the mask position with numpy : 0.009490966796875 nb_pixel_total : 7003 time to create 1 rle with old method : 0.0073506832122802734 time for calcul the mask position with numpy : 0.009389638900756836 nb_pixel_total : 2148 time to create 1 rle with old method : 0.002291440963745117 time for calcul the mask position with numpy : 0.005690813064575195 nb_pixel_total : 9031 time to create 1 rle with old method : 0.009428739547729492 time for calcul the mask position with numpy : 0.005663156509399414 nb_pixel_total : 6060 time to create 1 rle with old method : 0.006177663803100586 time for calcul the mask position with numpy : 0.009527921676635742 nb_pixel_total : 21012 time to create 1 rle with old method : 0.020560264587402344 time for calcul the mask position with numpy : 0.009327888488769531 nb_pixel_total : 7271 time to create 1 rle with old method : 0.007363557815551758 time for calcul the mask position with numpy : 0.009481191635131836 nb_pixel_total : 4802 time to create 1 rle with old method : 0.0049571990966796875 time for calcul the mask position with numpy : 0.009744644165039062 nb_pixel_total : 3379 time to create 1 rle with old method : 0.00356292724609375 time for calcul the mask position with numpy : 0.009626626968383789 nb_pixel_total : 5201 time to create 1 rle with old method : 0.005341529846191406 time for calcul the mask position with numpy : 0.009388923645019531 nb_pixel_total : 8709 time to create 1 rle with old method : 0.009058713912963867 time for calcul the mask position with numpy : 0.009903430938720703 nb_pixel_total : 12255 time to create 1 rle with old method : 0.01701068878173828 time for calcul the mask position with numpy : 0.006205081939697266 nb_pixel_total : 9137 time to create 1 rle with old method : 0.009814977645874023 time for calcul the mask position with numpy : 0.0059278011322021484 nb_pixel_total : 16007 time to create 1 rle with old method : 0.01622462272644043 time for calcul the mask position with numpy : 0.005708456039428711 nb_pixel_total : 22845 time to create 1 rle with old method : 0.02324223518371582 time for calcul the mask position with numpy : 0.005616188049316406 nb_pixel_total : 2668 time to create 1 rle with old method : 0.002656221389770508 time for calcul the mask position with numpy : 0.006460666656494141 nb_pixel_total : 49893 time to create 1 rle with old method : 0.051271915435791016 time for calcul the mask position with numpy : 0.005675315856933594 nb_pixel_total : 4304 time to create 1 rle with old method : 0.0046443939208984375 time for calcul the mask position with numpy : 0.005942106246948242 nb_pixel_total : 8371 time to create 1 rle with old method : 0.00899505615234375 time for calcul the mask position with numpy : 0.005872964859008789 nb_pixel_total : 18040 time to create 1 rle with old method : 0.02285027503967285 time for calcul the mask position with numpy : 0.009922981262207031 nb_pixel_total : 19676 time to create 1 rle with old method : 0.019671916961669922 time for calcul the mask position with numpy : 0.009509086608886719 nb_pixel_total : 5954 time to create 1 rle with old method : 0.006171703338623047 time for calcul the mask position with numpy : 0.009773492813110352 nb_pixel_total : 12103 time to create 1 rle with old method : 0.01286935806274414 create new chi : 0.602179765701294 time to delete rle : 0.0007431507110595703 batch 1 Loaded 48 chid ids of type : 4211 Number RLEs to save : 7392 TO DO : save crop sub photo not yet done ! save time : 2.964331865310669 nb_obj : 26 nb_hashtags : 6 time to prepare the origin masks : 2.3638131618499756 time for calcul the mask position with numpy : 0.025569915771484375 nb_pixel_total : 1799029 time to create 1 rle with new method : 0.07794427871704102 time for calcul the mask position with numpy : 0.005949974060058594 nb_pixel_total : 4167 time to create 1 rle with old method : 0.004632711410522461 time for calcul the mask position with numpy : 0.0057528018951416016 nb_pixel_total : 17844 time to create 1 rle with old method : 0.01862931251525879 time for calcul the mask position with numpy : 0.006370067596435547 nb_pixel_total : 2595 time to create 1 rle with old method : 0.002810239791870117 time for calcul the mask position with numpy : 0.00616002082824707 nb_pixel_total : 54582 time to create 1 rle with old method : 0.05769014358520508 time for calcul the mask position with numpy : 0.0060482025146484375 nb_pixel_total : 7914 time to create 1 rle with old method : 0.00867462158203125 time for calcul the mask position with numpy : 0.006268024444580078 nb_pixel_total : 7826 time to create 1 rle with old method : 0.00868678092956543 time for calcul the mask position with numpy : 0.006185293197631836 nb_pixel_total : 2238 time to create 1 rle with old method : 0.0025243759155273438 time for calcul the mask position with numpy : 0.006459474563598633 nb_pixel_total : 2608 time to create 1 rle with old method : 0.0029120445251464844 time for calcul the mask position with numpy : 0.0064754486083984375 nb_pixel_total : 4147 time to create 1 rle with old method : 0.004464149475097656 time for calcul the mask position with numpy : 0.006321430206298828 nb_pixel_total : 4421 time to create 1 rle with old method : 0.004981040954589844 time for calcul the mask position with numpy : 0.006001949310302734 nb_pixel_total : 7220 time to create 1 rle with old method : 0.007946014404296875 time for calcul the mask position with numpy : 0.005950927734375 nb_pixel_total : 4225 time to create 1 rle with old method : 0.00446772575378418 time for calcul the mask position with numpy : 0.005995988845825195 nb_pixel_total : 4182 time to create 1 rle with old method : 0.004459857940673828 time for calcul the mask position with numpy : 0.005817413330078125 nb_pixel_total : 7826 time to create 1 rle with old method : 0.008329629898071289 time for calcul the mask position with numpy : 0.005889892578125 nb_pixel_total : 6044 time to create 1 rle with old method : 0.006636381149291992 time for calcul the mask position with numpy : 0.006040811538696289 nb_pixel_total : 25325 time to create 1 rle with old method : 0.026734113693237305 time for calcul the mask position with numpy : 0.005927562713623047 nb_pixel_total : 11659 time to create 1 rle with old method : 0.01265573501586914 time for calcul the mask position with numpy : 0.0065441131591796875 nb_pixel_total : 17222 time to create 1 rle with old method : 0.020463943481445312 time for calcul the mask position with numpy : 0.0064525604248046875 nb_pixel_total : 1975 time to create 1 rle with old method : 0.0020236968994140625 time for calcul the mask position with numpy : 0.006311893463134766 nb_pixel_total : 7711 time to create 1 rle with old method : 0.007901430130004883 time for calcul the mask position with numpy : 0.0058977603912353516 nb_pixel_total : 2183 time to create 1 rle with old method : 0.0023550987243652344 time for calcul the mask position with numpy : 0.006351947784423828 nb_pixel_total : 37757 time to create 1 rle with old method : 0.04279732704162598 time for calcul the mask position with numpy : 0.006249666213989258 nb_pixel_total : 6123 time to create 1 rle with old method : 0.0062999725341796875 time for calcul the mask position with numpy : 0.006136894226074219 nb_pixel_total : 15944 time to create 1 rle with old method : 0.016553878784179688 time for calcul the mask position with numpy : 0.005841970443725586 nb_pixel_total : 8078 time to create 1 rle with old method : 0.008403301239013672 time for calcul the mask position with numpy : 0.0057833194732666016 nb_pixel_total : 2755 time to create 1 rle with old method : 0.0030210018157958984 create new chi : 0.567255973815918 time to delete rle : 0.0007843971252441406 batch 1 Loaded 53 chid ids of type : 4211 Number RLEs to save : 7776 TO DO : save crop sub photo not yet done ! save time : 2.5601067543029785 map_output_result : {1330289704: (0.0, 'Should be the crop_list due to order', 0.0), 1330289697: (0.0, 'Should be the crop_list due to order', 0.0), 1330289693: (0.0, 'Should be the crop_list due to order', 0.0), 1330289691: (0.0, 'Should be the crop_list due to order', 0.0), 1330289663: (0.0, 'Should be the crop_list due to order', 0.0), 1330289661: (0.0, 'Should be the crop_list due to order', 0.0), 1330289652: (0.0, 'Should be the crop_list due to order', 0.0), 1330289649: (0.0, 'Should be the crop_list due to order', 0.0), 1330289646: (0.0, 'Should be the crop_list due to order', 0.0), 1330289644: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1330289704, 1330289697, 1330289693, 1330289691, 1330289663, 1330289661, 1330289652, 1330289649, 1330289646, 1330289644] Looping around the photos to save general results len do output : 10 /1330289704.Didn't retrieve data . /1330289697.Didn't retrieve data . /1330289693.Didn't retrieve data . /1330289691.Didn't retrieve data . /1330289663.Didn't retrieve data . /1330289661.Didn't retrieve data . /1330289652.Didn't retrieve data . /1330289649.Didn't retrieve data . /1330289646.Didn't retrieve data . /1330289644.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289704', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289697', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289693', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289691', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289663', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289661', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289652', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289649', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289646', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289644', None, None, None, None, None, '2533517') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.020864486694335938 save_final save missing photos in datou_result : time spend for datou_step_exec : 71.85111212730408 time spend to save output : 0.021236419677734375 total time spend for step 8 : 71.87234854698181 step9:crop_condition Sat Feb 1 05:39:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4211 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 466 chid ids of type : 4211 begin to crop the class : barquette_opaque param for this class : {'min_score': 0.5} filtre for class : barquette_opaque hashtag_id of this class : 2107760128 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 53 About to insert : list_path_to_insert length 53 new photo from crops ! About to upload 53 photos upload in portfolio : 4869462 init cache_photo without model_param we have 53 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738384762_3330313 we have uploaded 53 photos in the portfolio 4869462 time of upload the photos Elapsed time : 16.00598955154419 we have finished the crop for the class : barquette_opaque begin to crop the class : carton param for this class : {'min_score': 0.5} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 4869462 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738384778_3330313 we have uploaded 4 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.1761856079101562 we have finished the crop for the class : carton begin to crop the class : ela param for this class : {'min_score': 0.5} filtre for class : ela hashtag_id of this class : 492741797 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738384781_3330313 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.5930354595184326 we have finished the crop for the class : ela begin to crop the class : environnement param for this class : {'min_score': 0.5} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738384782_3330313 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.9749834537506104 we have finished the crop for the class : environnement begin to crop the class : etiquette param for this class : {'min_score': 0.5} filtre for class : etiquette hashtag_id of this class : 492636447 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 42 About to insert : list_path_to_insert length 42 new photo from crops ! About to upload 42 photos upload in portfolio : 4869462 init cache_photo without model_param we have 42 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738384785_3330313 we have uploaded 42 photos in the portfolio 4869462 time of upload the photos Elapsed time : 9.29138970375061 we have finished the crop for the class : etiquette begin to crop the class : film_plastique param for this class : {'min_score': 0.5} filtre for class : film_plastique hashtag_id of this class : 2107756122 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 4869462 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738384795_3330313 we have uploaded 12 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.702713966369629 we have finished the crop for the class : film_plastique begin to crop the class : kraft param for this class : {'min_score': 0.5} filtre for class : kraft hashtag_id of this class : 493202403 begin to crop the class : metal param for this class : {'min_score': 0.5} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 4869462 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738384798_3330313 we have uploaded 6 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.292505979537964 we have finished the crop for the class : metal begin to crop the class : pehd param for this class : {'min_score': 0.5} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 4869462 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738384846_3330313 we have uploaded 10 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.205472707748413 we have finished the crop for the class : pehd begin to crop the class : pet_clair param for this class : {'min_score': 0.5} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738384850_3330313 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.9972195625305176 we have finished the crop for the class : pet_clair begin to crop the class : pet_opaque param for this class : {'min_score': 0.5} filtre for class : pet_opaque hashtag_id of this class : 2107759152 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 4869462 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738384852_3330313 we have uploaded 7 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.6784961223602295 we have finished the crop for the class : pet_opaque begin to crop the class : textiles_sanitaires param for this class : {'min_score': 0.5} filtre for class : textiles_sanitaires hashtag_id of this class : 2107760129 begin to crop the class : pet_fonce param for this class : {'min_score': 0.5} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738384857_3330313 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.3650259971618652 we have finished the crop for the class : pet_fonce begin to crop the class : papier param for this class : {'min_score': 0.5} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 4869462 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738384861_3330313 we have uploaded 26 photos in the portfolio 4869462 time of upload the photos Elapsed time : 6.117717266082764 we have finished the crop for the class : papier delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1330289704, 1330289697, 1330289693, 1330289691, 1330289663, 1330289661, 1330289652, 1330289649, 1330289646, 1330289644] Looping around the photos to save general results len do output : 166 /1333607934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333607999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608056Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608060Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608064Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608066Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333608199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289704', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289697', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289693', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289691', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289663', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289661', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289652', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289649', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289646', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289644', None, None, None, None, None, '2533517') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 508 time used for this insertion : 1.501094102859497 save_final save missing photos in datou_result : time spend for datou_step_exec : 110.25084161758423 time spend to save output : 1.5063936710357666 total time spend for step 9 : 111.75723528862 step10:ventilate_hashtags_in_portfolio Sat Feb 1 05:41:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 19770008 get user id for portfolio 19770008 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19770008 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','pet_fonce','metal','barquette_opaque','carton','etiquette','pet_opaque','mal_croppe','pehd','papier','film_plastique','ela','textiles_sanitaires','environnement','kraft','flou')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19770008 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','pet_fonce','metal','barquette_opaque','carton','etiquette','pet_opaque','mal_croppe','pehd','papier','film_plastique','ela','textiles_sanitaires','environnement','kraft','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/19787338,19787339,19787340,19787341,19787342,19787343,19787344,19787345,19787346,19787347,19787348,19787349,19787350,19787351,19787352,19787353?tags=environnement,pet_clair,mal_croppe,film_plastique,carton,ela,etiquette,pehd,kraft,pet_opaque,flou,metal,barquette_opaque,papier,textiles_sanitaires,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1330289704, 1330289697, 1330289693, 1330289691, 1330289663, 1330289661, 1330289652, 1330289649, 1330289646, 1330289644] Looping around the photos to save general results len do output : 1 /19770008. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289704', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289697', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289693', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289691', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289663', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289661', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289652', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289649', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289646', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289644', None, None, None, None, None, '2533517') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.01344156265258789 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.46602463722229 time spend to save output : 0.013672828674316406 total time spend for step 10 : 2.4796974658966064 step11:final Sat Feb 1 05:41:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1330289704: ('0.0722378520521979',), 1330289697: ('0.0722378520521979',), 1330289693: ('0.0722378520521979',), 1330289691: ('0.0722378520521979',), 1330289663: ('0.0722378520521979',), 1330289661: ('0.0722378520521979',), 1330289652: ('0.0722378520521979',), 1330289649: ('0.0722378520521979',), 1330289646: ('0.0722378520521979',), 1330289644: ('0.0722378520521979',)} new output for save of step final : {1330289704: ('0.0722378520521979',), 1330289697: ('0.0722378520521979',), 1330289693: ('0.0722378520521979',), 1330289691: ('0.0722378520521979',), 1330289663: ('0.0722378520521979',), 1330289661: ('0.0722378520521979',), 1330289652: ('0.0722378520521979',), 1330289649: ('0.0722378520521979',), 1330289646: ('0.0722378520521979',), 1330289644: ('0.0722378520521979',)} [1330289704, 1330289697, 1330289693, 1330289691, 1330289663, 1330289661, 1330289652, 1330289649, 1330289646, 1330289644] Looping around the photos to save general results len do output : 10 /1330289704.Didn't retrieve data . /1330289697.Didn't retrieve data . /1330289693.Didn't retrieve data . /1330289691.Didn't retrieve data . /1330289663.Didn't retrieve data . /1330289661.Didn't retrieve data . /1330289652.Didn't retrieve data . /1330289649.Didn't retrieve data . /1330289646.Didn't retrieve data . /1330289644.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289704', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289697', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289693', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289691', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289663', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289661', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289652', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289649', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289646', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289644', None, None, None, None, None, '2533517') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.01560521125793457 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10323309898376465 time spend to save output : 0.016091346740722656 total time spend for step 11 : 0.1193244457244873 step12:velours_tree Sat Feb 1 05:41:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.03636360168457031 time spend to save output : 4.3392181396484375e-05 total time spend for step 12 : 0.0364069938659668 step13:send_mail_cod Sat Feb 1 05:41:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P19770008_01-02-2025_05_41_12.pdf 19787339 change filename to text .change filename to text .change filename to text .imagette197873391738384872 19787340 imagette197873401738384872 19787341 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197873411738384872 19787342 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197873421738384873 19787343 change filename to text .imagette197873431738384873 19787344 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197873441738384873 19787346 imagette197873461738384874 19787347 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197873471738384874 19787348 imagette197873481738384875 19787349 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197873491738384875 19787350 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197873501738384876 19787351 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197873511738384877 19787352 imagette197873521738384878 19787353 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197873531738384878 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=19770008 and hashtag_type = 4211 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/19787338,19787339,19787340,19787341,19787342,19787343,19787344,19787345,19787346,19787347,19787348,19787349,19787350,19787351,19787352,19787353?tags=environnement,pet_clair,mal_croppe,film_plastique,carton,ela,etiquette,pehd,kraft,pet_opaque,flou,metal,barquette_opaque,papier,textiles_sanitaires,pet_fonce your option no_mail is active, we will not send the real mail to your client args[1330289704] : ((1330289704, -1.9720208965721027, 492688767), (1330289704, -0.28259699036359404, 496442774), '0.0722378520521979') We are sending mail with results at report@fotonower.com args[1330289697] : ((1330289697, -2.7878556502665086, 492609224), (1330289697, -0.1332248905698203, 496442774), '0.0722378520521979') We are sending mail with results at report@fotonower.com args[1330289693] : ((1330289693, -3.8068090465220594, 492609224), (1330289693, -0.11264795024765131, 496442774), '0.0722378520521979') We are sending mail with results at report@fotonower.com args[1330289691] : ((1330289691, -4.0781561224287675, 492609224), (1330289691, -0.11050925130216185, 496442774), '0.0722378520521979') We are sending mail with results at report@fotonower.com args[1330289663] : ((1330289663, -1.7927893235132948, 492688767), (1330289663, -0.1435338473914289, 496442774), '0.0722378520521979') We are sending mail with results at report@fotonower.com args[1330289661] : ((1330289661, -2.8121292054249833, 492609224), (1330289661, -0.13816128341354877, 496442774), '0.0722378520521979') We are sending mail with results at report@fotonower.com args[1330289652] : ((1330289652, -2.0393103680716993, 492609224), (1330289652, -0.13451844428295354, 496442774), '0.0722378520521979') We are sending mail with results at report@fotonower.com args[1330289649] : ((1330289649, -1.7353702334553744, 492688767), (1330289649, -0.16764110137264168, 496442774), '0.0722378520521979') We are sending mail with results at report@fotonower.com args[1330289646] : ((1330289646, -1.305086795524135, 492688767), (1330289646, -0.10495597682729191, 496442774), '0.0722378520521979') We are sending mail with results at report@fotonower.com args[1330289644] : ((1330289644, -1.952194937695519, 492688767), (1330289644, -0.2129347456917425, 496442774), '0.0722378520521979') We are sending mail with results at report@fotonower.com refus_total : 0.0722378520521979 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=19770008 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1330289663,1330289661,1330289758,1330289644,1330289706,1330289848,1330289842,1330289820,1330289761,1330289752,1330289736,1330289733,1330289711,1330289704,1330289697,1330289693,1330289691,1330289652,1330289649,1330289646) Found this number of photos: 20 begin to download photo : 1330289663 begin to download photo : 1330289848 begin to download photo : 1330289736 begin to download photo : 1330289693 download finish for photo 1330289663 begin to download photo : 1330289661 download finish for photo 1330289848 begin to download photo : 1330289842 download finish for photo 1330289736 begin to download photo : 1330289733 download finish for photo 1330289693 begin to download photo : 1330289691 download finish for photo 1330289661 begin to download photo : 1330289758 download finish for photo 1330289842 begin to download photo : 1330289820 download finish for photo 1330289733 begin to download photo : 1330289711 download finish for photo 1330289691 begin to download photo : 1330289652 download finish for photo 1330289758 begin to download photo : 1330289644 download finish for photo 1330289820 begin to download photo : 1330289761 download finish for photo 1330289711 begin to download photo : 1330289704 download finish for photo 1330289644 begin to download photo : 1330289706 download finish for photo 1330289652 begin to download photo : 1330289649 download finish for photo 1330289704 begin to download photo : 1330289697 download finish for photo 1330289706 download finish for photo 1330289761 begin to download photo : 1330289752 download finish for photo 1330289649 begin to download photo : 1330289646 download finish for photo 1330289697 download finish for photo 1330289752 download finish for photo 1330289646 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19770008_01-02-2025_05_41_12.pdf results_Auto_P19770008_01-02-2025_05_41_12.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19770008_01-02-2025_05_41_12.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4909','19770008','results_Auto_P19770008_01-02-2025_05_41_12.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19770008_01-02-2025_05_41_12.pdf','pdf','','0.48','0.0722378520521979') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1330289704, 1330289697, 1330289693, 1330289691, 1330289663, 1330289661, 1330289652, 1330289649, 1330289646, 1330289644] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289704', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289697', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289693', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289691', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289663', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289661', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289652', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289649', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289646', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289644', None, None, None, None, None, '2533517') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.0144195556640625 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.006282567977905 time spend to save output : 0.014610528945922852 total time spend for step 13 : 9.020893096923828 step14:split_time_score Sat Feb 1 05:41:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('19', 6), ('20', 14)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 20012025 19770008 Nombre de photos uploadées : 20 / 23040 (0%) 20012025 19770008 Nombre de photos taguées (types de déchets): 0 / 20 (0%) 20012025 19770008 Nombre de photos taguées (volume) : 0 / 20 (0%) elapsed_time : load_data_split_time_score 2.6226043701171875e-06 elapsed_time : order_list_meta_photo_and_scores 8.821487426757812e-06 ???????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.001260995864868164 elapsed_time : insert_dashboard_record_day_entry 0.024249792098999023 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.05368542655064632 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19756680_20-01-2025_15_42_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19756680 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19756680 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19758113_24-01-2025_03_37_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19758113 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19759715_21-01-2025_11_22_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19759715 order by id desc limit 1 Qualite : 0.06918528095839836 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19759717_20-01-2025_16_35_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19759717 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19759717 AND mptpi.`type`=4207 To do Qualite : 0.15889673840838808 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19760921_21-01-2025_02_16_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19760921 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19760921 AND mptpi.`type`=3327 To do Qualite : 0.06950101375332633 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19760922_20-01-2025_17_21_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19760922 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19760922 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19762317_21-01-2025_13_06_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19762317 order by id desc limit 1 Qualite : 0.12856035913273142 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19762319_21-01-2025_02_30_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19762319 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19762319 AND mptpi.`type`=3327 To do Qualite : 0.050119454659034675 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19764097_20-01-2025_19_04_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19764097 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19764097 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19764099_21-01-2025_14_11_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19764099 order by id desc limit 1 Qualite : 0.0786938007210795 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19764105_20-01-2025_18_54_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19764105 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19764105 AND mptpi.`type`=4207 To do Qualite : 0.03603286478179441 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767139_01-02-2025_05_10_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767139 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19767139 AND mptpi.`type`=4211 To do Qualite : 0.0 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767140_21-01-2025_04_23_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767140 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19767140 AND mptpi.`type`=4209 To do Qualite : 0.06752219012654 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767141_20-01-2025_19_53_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767141 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19767141 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767142_22-01-2025_08_47_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767142 order by id desc limit 1 Qualite : 0.0927947099350885 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767143_21-01-2025_02_39_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767143 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19767143 AND mptpi.`type`=3327 To do Qualite : 0.03400019813689533 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767144_21-01-2025_04_33_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767144 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19767144 AND mptpi.`type`=4205 To do Qualite : 0.06198034924246159 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767145_20-01-2025_19_46_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767145 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19767145 AND mptpi.`type`=4207 To do Qualite : 0.07309230429021216 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19768584_21-01-2025_02_07_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19768584 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19768584 AND mptpi.`type`=3327 To do Qualite : 0.05940739517148176 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19768589_20-01-2025_20_14_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19768589 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19768589 AND mptpi.`type`=4207 To do Qualite : 0.04021439758210432 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19770008_01-02-2025_05_41_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19770008 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19770008 AND mptpi.`type`=4211 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19770010_22-01-2025_09_13_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19770010 order by id desc limit 1 Qualite : 0.045333373431294996 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19770011_20-01-2025_21_18_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19770011 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19770011 AND mptpi.`type`=4207 To do Qualite : 0.08460401115881525 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19770012_21-01-2025_01_51_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19770012 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19770012 AND mptpi.`type`=3327 To do Qualite : 0.038192458824297226 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19772060_01-02-2025_05_02_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19772060 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19772060 AND mptpi.`type`=4211 To do Qualite : 0.05919716841688413 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19772062_20-01-2025_21_46_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19772062 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19772062 AND mptpi.`type`=4207 To do Qualite : 0.05021197427524266 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19773068_22-01-2025_17_53_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19773068 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19773068 AND mptpi.`type`=4203 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19773069_22-01-2025_16_13_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19773069 order by id desc limit 1 Qualite : 0.09343093275297072 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19773070_20-01-2025_23_18_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19773070 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19773070 AND mptpi.`type`=3327 To do Qualite : 0.05267148959863112 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19773071_01-02-2025_04_12_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19773071 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19773071 AND mptpi.`type`=4211 To do Qualite : 0.06740297704934484 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19774194_20-01-2025_22_43_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19774194 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19774194 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777200_22-01-2025_18_48_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777200 order by id desc limit 1 Qualite : 0.05421734473668348 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777201_21-01-2025_01_27_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777201 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777201 AND mptpi.`type`=3327 To do Qualite : 0.044092539373829086 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777202_21-01-2025_00_21_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777202 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777202 AND mptpi.`type`=4207 To do Qualite : 0.04190112060013058 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777203_01-02-2025_02_38_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777203 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777203 AND mptpi.`type`=4211 To do Qualite : 0.048840458590288995 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777205_21-01-2025_00_13_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777205 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777205 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777206_24-01-2025_03_16_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777206 order by id desc limit 1 Qualite : 0.09987592641146087 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777207_21-01-2025_00_56_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777207 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777207 AND mptpi.`type`=3327 To do Qualite : 0.0 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777208_21-01-2025_12_02_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777208 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777208 AND mptpi.`type`=4209 To do Qualite : 0.03332046749521877 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777209_01-02-2025_03_30_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777209 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777209 AND mptpi.`type`=4211 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'20012025': {'nb_upload': 20, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1330289704, 1330289697, 1330289693, 1330289691, 1330289663, 1330289661, 1330289652, 1330289649, 1330289646, 1330289644] Looping around the photos to save general results len do output : 1 /19770008Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289704', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289697', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289693', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289691', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289663', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289661', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289652', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289649', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289646', None, None, None, None, None, '2533517') ('4909', None, None, None, None, None, None, None, '2533517') ('4909', None, '1330289644', None, None, None, None, None, '2533517') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.016881942749023438 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.210644483566284 time spend to save output : 0.017097949981689453 total time spend for step 14 : 6.227742433547974 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 147.01user 55.74system 7:03.37elapsed 47%CPU (0avgtext+0avgdata 3580948maxresident)k 3215768inputs+165352outputs (20315major+5889191minor)pagefaults 0swaps