python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4909 -l 10 ' -s datou_current_4909 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2640705 load datou : 4909 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? id de la photo (peut être local ou global) was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5359, 'Mask_Limeil_Label_PEHD_080621', 16384, 25088, 'Mask_Limeil_Label_PEHD_080621', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 6, 9, 7, 22, 34), datetime.datetime(2021, 6, 9, 7, 22, 34)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5557, 'learn_generique_01122021_6000_v2', 2048, 2048, 'learn_generique_01122021_6000_v2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 1, 19, 59, 17), datetime.datetime(2021, 12, 1, 19, 59, 17)) load thcls load THCL from format json or kwargs add thcl : 2976 in CacheModelConfig load THCL from format json or kwargs add thcl : 3233 in CacheModelConfig load pdts add pdt : 5359 in CacheModelConfig add pdt : 5557 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 18>10 please execute split_portfolio.py -i 19777203 -l 10 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4909, datou_cur_ids : ['2533520'] with mtr_portfolio_ids : ['19777203'] and first list_photo_ids : [] new path : /proc/2640705/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, blur_detection, brightness, crop_condition, thcl, argmax, merge_mask_thcl_custom, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 1.5859320163726807 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 14 step1:mask_detect Sat Feb 1 02:04:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10332 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-01 02:04:31.290861: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-01 02:04:31.323562: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493020000 Hz 2025-02-01 02:04:31.325751: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f7dfc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-01 02:04:31.325797: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-01 02:04:31.329700: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-01 02:04:31.547960: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1a2a9570 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-01 02:04:31.548008: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-01 02:04:31.549375: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 02:04:31.549757: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 02:04:31.552499: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 02:04:31.554605: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 02:04:31.554998: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 02:04:31.557539: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 02:04:31.558875: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 02:04:31.564136: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 02:04:31.565607: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 02:04:31.565679: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 02:04:31.566477: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 02:04:31.566496: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 02:04:31.566505: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 02:04:31.567918: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9570 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-01 02:04:31.838049: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 02:04:31.838203: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 02:04:31.838247: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 02:04:31.838283: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 02:04:31.838311: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 02:04:31.838331: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 02:04:31.838352: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 02:04:31.838373: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 02:04:31.840288: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 02:04:31.841974: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 02:04:31.842083: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 02:04:31.842110: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 02:04:31.842138: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 02:04:31.842162: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 02:04:31.842188: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 02:04:31.842224: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 02:04:31.842249: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 02:04:31.843858: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 02:04:31.843905: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 02:04:31.843918: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 02:04:31.843929: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 02:04:31.845665: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9570 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2976 thcls : [{'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5359 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5359, 'Mask_Limeil_Label_PEHD_080621', 16384, 25088, 'Mask_Limeil_Label_PEHD_080621', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 6, 9, 7, 22, 34), datetime.datetime(2021, 6, 9, 7, 22, 34)) {'thcl': {'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'environnement', 'fibreux_cont', 'metal_cont', 'pet_clair_cont', 'pet_fonce_cont', 'pet_opaque_cont', 'barquette', 'film_plastique', 'autre_contaminant', 'etiquette_detachee'], 'list_hashtags_csv': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'svm_hashtag_type_desc': 5359, 'photo_desc_type': 5359, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'environnement', 'fibreux_cont', 'metal_cont', 'pet_clair_cont', 'pet_fonce_cont', 'pet_opaque_cont', 'barquette', 'film_plastique', 'autre_contaminant', 'etiquette_detachee'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME Mask_Limeil_Label_PEHD_080621 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : Mask_Limeil_Label_PEHD_080621 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-01 02:04:39.605611: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 02:04:39.802083: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/Mask_Limeil_Label_PEHD_080621 /data/models_weight/Mask_Limeil_Label_PEHD_080621/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2021-08-11 19:43:15 create time in s3 : 2021-08-06 17:21:30 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 67 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 72 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 69 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 82 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 65 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 84 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 60 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 70 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 76 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 58 Detection mask done ! Trying to reset tf kernel 2641146 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5043 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10332 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2976 Catched exception ! Connect or reconnect ! thcls : [{'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5359 ['background', 'environnement', 'fibreux_cont', 'metal_cont', 'pet_clair_cont', 'pet_fonce_cont', 'pet_opaque_cont', 'barquette', 'film_plastique', 'autre_contaminant', 'etiquette_detachee'] time for calcul the mask position with numpy : 0.003408670425415039 nb_pixel_total : 119166 time to create 1 rle with old method : 0.1381373405456543 length of segment : 459 time for calcul the mask position with numpy : 0.0015363693237304688 nb_pixel_total : 70019 time to create 1 rle with old method : 0.0795283317565918 length of segment : 348 time for calcul the mask position with numpy : 0.0018079280853271484 nb_pixel_total : 71844 time to create 1 rle with old method : 0.08540058135986328 length of segment : 356 time for calcul the mask position with numpy : 0.0005497932434082031 nb_pixel_total : 26795 time to create 1 rle with old method : 0.030510663986206055 length of segment : 181 time for calcul the mask position with numpy : 0.00019931793212890625 nb_pixel_total : 7526 time to create 1 rle with old method : 0.009007930755615234 length of segment : 95 time for calcul the mask position with numpy : 0.0022194385528564453 nb_pixel_total : 113647 time to create 1 rle with old method : 0.12995338439941406 length of segment : 492 time for calcul the mask position with numpy : 0.00018644332885742188 nb_pixel_total : 7669 time to create 1 rle with old method : 0.008835315704345703 length of segment : 95 time for calcul the mask position with numpy : 0.0015764236450195312 nb_pixel_total : 85719 time to create 1 rle with old method : 0.09148955345153809 length of segment : 429 time for calcul the mask position with numpy : 0.0002989768981933594 nb_pixel_total : 13589 time to create 1 rle with old method : 0.01403045654296875 length of segment : 138 time for calcul the mask position with numpy : 0.00039958953857421875 nb_pixel_total : 10084 time to create 1 rle with old method : 0.01621222496032715 length of segment : 194 time for calcul the mask position with numpy : 0.0004458427429199219 nb_pixel_total : 18339 time to create 1 rle with old method : 0.02364802360534668 length of segment : 152 time for calcul the mask position with numpy : 0.00028133392333984375 nb_pixel_total : 12861 time to create 1 rle with old method : 0.014330625534057617 length of segment : 142 time for calcul the mask position with numpy : 0.0013413429260253906 nb_pixel_total : 81668 time to create 1 rle with old method : 0.10181665420532227 length of segment : 491 time for calcul the mask position with numpy : 0.0002868175506591797 nb_pixel_total : 9256 time to create 1 rle with old method : 0.011650800704956055 length of segment : 100 time for calcul the mask position with numpy : 0.00036072731018066406 nb_pixel_total : 15277 time to create 1 rle with old method : 0.01897573471069336 length of segment : 175 time for calcul the mask position with numpy : 8.20159912109375e-05 nb_pixel_total : 1803 time to create 1 rle with old method : 0.0021507740020751953 length of segment : 68 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 633 time to create 1 rle with old method : 0.000820159912109375 length of segment : 40 time for calcul the mask position with numpy : 0.0006718635559082031 nb_pixel_total : 37743 time to create 1 rle with old method : 0.03995180130004883 length of segment : 232 time for calcul the mask position with numpy : 0.0005528926849365234 nb_pixel_total : 19489 time to create 1 rle with old method : 0.021732807159423828 length of segment : 212 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 933 time to create 1 rle with old method : 0.0012712478637695312 length of segment : 33 time for calcul the mask position with numpy : 0.0003521442413330078 nb_pixel_total : 15823 time to create 1 rle with old method : 0.016991138458251953 length of segment : 192 time for calcul the mask position with numpy : 0.00010967254638671875 nb_pixel_total : 3814 time to create 1 rle with old method : 0.004241943359375 length of segment : 65 time for calcul the mask position with numpy : 0.00040221214294433594 nb_pixel_total : 18281 time to create 1 rle with old method : 0.02016925811767578 length of segment : 181 time for calcul the mask position with numpy : 0.0002551078796386719 nb_pixel_total : 7763 time to create 1 rle with old method : 0.00909733772277832 length of segment : 142 time for calcul the mask position with numpy : 0.0001354217529296875 nb_pixel_total : 4504 time to create 1 rle with old method : 0.005613565444946289 length of segment : 74 time for calcul the mask position with numpy : 0.0007569789886474609 nb_pixel_total : 44832 time to create 1 rle with old method : 0.05418825149536133 length of segment : 274 time for calcul the mask position with numpy : 0.00030875205993652344 nb_pixel_total : 7554 time to create 1 rle with old method : 0.008658170700073242 length of segment : 129 time for calcul the mask position with numpy : 0.0001761913299560547 nb_pixel_total : 8109 time to create 1 rle with old method : 0.00927424430847168 length of segment : 108 time for calcul the mask position with numpy : 0.00035762786865234375 nb_pixel_total : 14726 time to create 1 rle with old method : 0.017064332962036133 length of segment : 144 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 1993 time to create 1 rle with old method : 0.002637624740600586 length of segment : 40 time for calcul the mask position with numpy : 0.00030922889709472656 nb_pixel_total : 5932 time to create 1 rle with old method : 0.007166385650634766 length of segment : 122 time for calcul the mask position with numpy : 0.001753091812133789 nb_pixel_total : 83795 time to create 1 rle with old method : 0.08968448638916016 length of segment : 377 time for calcul the mask position with numpy : 0.0015399456024169922 nb_pixel_total : 69898 time to create 1 rle with old method : 0.07687687873840332 length of segment : 397 time for calcul the mask position with numpy : 0.000240325927734375 nb_pixel_total : 8096 time to create 1 rle with old method : 0.009060382843017578 length of segment : 141 time for calcul the mask position with numpy : 0.0002200603485107422 nb_pixel_total : 9640 time to create 1 rle with old method : 0.010380029678344727 length of segment : 105 time for calcul the mask position with numpy : 0.0027310848236083984 nb_pixel_total : 123113 time to create 1 rle with old method : 0.1328284740447998 length of segment : 459 time for calcul the mask position with numpy : 0.0022857189178466797 nb_pixel_total : 87436 time to create 1 rle with old method : 0.10632705688476562 length of segment : 366 time for calcul the mask position with numpy : 0.0011138916015625 nb_pixel_total : 26656 time to create 1 rle with old method : 0.029464006423950195 length of segment : 159 time for calcul the mask position with numpy : 0.004035472869873047 nb_pixel_total : 97145 time to create 1 rle with old method : 0.10373377799987793 length of segment : 449 time for calcul the mask position with numpy : 0.00032711029052734375 nb_pixel_total : 4324 time to create 1 rle with old method : 0.00507807731628418 length of segment : 73 time for calcul the mask position with numpy : 0.00010585784912109375 nb_pixel_total : 3391 time to create 1 rle with old method : 0.0041849613189697266 length of segment : 56 time for calcul the mask position with numpy : 0.0005357265472412109 nb_pixel_total : 11246 time to create 1 rle with old method : 0.01266026496887207 length of segment : 140 time for calcul the mask position with numpy : 0.0003333091735839844 nb_pixel_total : 14478 time to create 1 rle with old method : 0.016341447830200195 length of segment : 145 time for calcul the mask position with numpy : 0.0004684925079345703 nb_pixel_total : 9254 time to create 1 rle with old method : 0.011116504669189453 length of segment : 103 time for calcul the mask position with numpy : 0.0029418468475341797 nb_pixel_total : 86577 time to create 1 rle with old method : 0.0949866771697998 length of segment : 566 time for calcul the mask position with numpy : 0.0007345676422119141 nb_pixel_total : 11428 time to create 1 rle with old method : 0.012751102447509766 length of segment : 111 time for calcul the mask position with numpy : 0.0010700225830078125 nb_pixel_total : 12521 time to create 1 rle with old method : 0.013803958892822266 length of segment : 129 time for calcul the mask position with numpy : 0.0006530284881591797 nb_pixel_total : 9457 time to create 1 rle with old method : 0.010732173919677734 length of segment : 130 time for calcul the mask position with numpy : 0.0008509159088134766 nb_pixel_total : 11188 time to create 1 rle with old method : 0.012742757797241211 length of segment : 168 time for calcul the mask position with numpy : 0.0004248619079589844 nb_pixel_total : 5478 time to create 1 rle with old method : 0.006101846694946289 length of segment : 101 time for calcul the mask position with numpy : 0.0004131793975830078 nb_pixel_total : 5631 time to create 1 rle with old method : 0.006671905517578125 length of segment : 81 time for calcul the mask position with numpy : 0.000507354736328125 nb_pixel_total : 9356 time to create 1 rle with old method : 0.011390924453735352 length of segment : 80 time for calcul the mask position with numpy : 0.00034165382385253906 nb_pixel_total : 4786 time to create 1 rle with old method : 0.005716800689697266 length of segment : 70 time for calcul the mask position with numpy : 0.0002090930938720703 nb_pixel_total : 1138 time to create 1 rle with old method : 0.0020949840545654297 length of segment : 40 time for calcul the mask position with numpy : 0.0004172325134277344 nb_pixel_total : 5530 time to create 1 rle with old method : 0.00928497314453125 length of segment : 78 time for calcul the mask position with numpy : 0.0011069774627685547 nb_pixel_total : 17243 time to create 1 rle with old method : 0.02689194679260254 length of segment : 256 time for calcul the mask position with numpy : 0.0003924369812011719 nb_pixel_total : 4576 time to create 1 rle with old method : 0.0053446292877197266 length of segment : 97 time for calcul the mask position with numpy : 0.0013649463653564453 nb_pixel_total : 25350 time to create 1 rle with old method : 0.02810359001159668 length of segment : 213 time for calcul the mask position with numpy : 0.00038886070251464844 nb_pixel_total : 16134 time to create 1 rle with old method : 0.01756572723388672 length of segment : 231 time for calcul the mask position with numpy : 0.00038695335388183594 nb_pixel_total : 4063 time to create 1 rle with old method : 0.004889726638793945 length of segment : 87 time for calcul the mask position with numpy : 0.0003936290740966797 nb_pixel_total : 8403 time to create 1 rle with old method : 0.009351968765258789 length of segment : 110 time for calcul the mask position with numpy : 0.00020265579223632812 nb_pixel_total : 2257 time to create 1 rle with old method : 0.002784252166748047 length of segment : 55 time for calcul the mask position with numpy : 8.320808410644531e-05 nb_pixel_total : 2362 time to create 1 rle with old method : 0.002844095230102539 length of segment : 60 time for calcul the mask position with numpy : 0.0007610321044921875 nb_pixel_total : 12625 time to create 1 rle with old method : 0.014427661895751953 length of segment : 125 time for calcul the mask position with numpy : 0.0004980564117431641 nb_pixel_total : 7913 time to create 1 rle with old method : 0.00959324836730957 length of segment : 74 time for calcul the mask position with numpy : 0.0005495548248291016 nb_pixel_total : 9512 time to create 1 rle with old method : 0.010895490646362305 length of segment : 187 time for calcul the mask position with numpy : 0.00031948089599609375 nb_pixel_total : 9279 time to create 1 rle with old method : 0.010515213012695312 length of segment : 168 time for calcul the mask position with numpy : 0.004479408264160156 nb_pixel_total : 100674 time to create 1 rle with old method : 0.1145162582397461 length of segment : 380 time for calcul the mask position with numpy : 0.004649162292480469 nb_pixel_total : 115189 time to create 1 rle with old method : 0.1301734447479248 length of segment : 427 time for calcul the mask position with numpy : 0.0037698745727539062 nb_pixel_total : 96571 time to create 1 rle with old method : 0.11336207389831543 length of segment : 402 time for calcul the mask position with numpy : 0.0037758350372314453 nb_pixel_total : 102492 time to create 1 rle with old method : 0.13540863990783691 length of segment : 469 time for calcul the mask position with numpy : 0.0005865097045898438 nb_pixel_total : 12317 time to create 1 rle with old method : 0.017043590545654297 length of segment : 128 time for calcul the mask position with numpy : 0.005225181579589844 nb_pixel_total : 98975 time to create 1 rle with old method : 0.11330819129943848 length of segment : 534 time for calcul the mask position with numpy : 0.00027441978454589844 nb_pixel_total : 1592 time to create 1 rle with old method : 0.0019116401672363281 length of segment : 57 time for calcul the mask position with numpy : 0.0008733272552490234 nb_pixel_total : 14722 time to create 1 rle with old method : 0.01699995994567871 length of segment : 162 time for calcul the mask position with numpy : 0.0001678466796875 nb_pixel_total : 1482 time to create 1 rle with old method : 0.0021893978118896484 length of segment : 57 time for calcul the mask position with numpy : 0.00010752677917480469 nb_pixel_total : 469 time to create 1 rle with old method : 0.0006322860717773438 length of segment : 26 time for calcul the mask position with numpy : 0.0027463436126708984 nb_pixel_total : 104792 time to create 1 rle with old method : 0.1173410415649414 length of segment : 531 time for calcul the mask position with numpy : 0.0008566379547119141 nb_pixel_total : 9825 time to create 1 rle with old method : 0.012004613876342773 length of segment : 210 time for calcul the mask position with numpy : 0.0002779960632324219 nb_pixel_total : 5066 time to create 1 rle with old method : 0.005742073059082031 length of segment : 119 time for calcul the mask position with numpy : 0.000606536865234375 nb_pixel_total : 8724 time to create 1 rle with old method : 0.010244607925415039 length of segment : 120 time for calcul the mask position with numpy : 0.0004961490631103516 nb_pixel_total : 5788 time to create 1 rle with old method : 0.006593465805053711 length of segment : 138 time for calcul the mask position with numpy : 0.0002963542938232422 nb_pixel_total : 4303 time to create 1 rle with old method : 0.005232810974121094 length of segment : 61 time for calcul the mask position with numpy : 0.0002994537353515625 nb_pixel_total : 2943 time to create 1 rle with old method : 0.0033674240112304688 length of segment : 89 time for calcul the mask position with numpy : 0.0004076957702636719 nb_pixel_total : 4387 time to create 1 rle with old method : 0.005210399627685547 length of segment : 94 time for calcul the mask position with numpy : 0.0005648136138916016 nb_pixel_total : 11211 time to create 1 rle with old method : 0.013307571411132812 length of segment : 96 time for calcul the mask position with numpy : 0.001512765884399414 nb_pixel_total : 24021 time to create 1 rle with old method : 0.025807857513427734 length of segment : 240 time for calcul the mask position with numpy : 0.0005829334259033203 nb_pixel_total : 6831 time to create 1 rle with old method : 0.008265256881713867 length of segment : 128 time for calcul the mask position with numpy : 0.000125885009765625 nb_pixel_total : 2086 time to create 1 rle with old method : 0.0027027130126953125 length of segment : 52 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 695 time to create 1 rle with old method : 0.001222848892211914 length of segment : 37 time for calcul the mask position with numpy : 0.0034673213958740234 nb_pixel_total : 60335 time to create 1 rle with old method : 0.07066965103149414 length of segment : 349 time for calcul the mask position with numpy : 0.0004146099090576172 nb_pixel_total : 5520 time to create 1 rle with old method : 0.006641387939453125 length of segment : 68 time for calcul the mask position with numpy : 0.004652500152587891 nb_pixel_total : 96419 time to create 1 rle with old method : 0.10802078247070312 length of segment : 410 time for calcul the mask position with numpy : 0.0034117698669433594 nb_pixel_total : 68026 time to create 1 rle with old method : 0.07088041305541992 length of segment : 360 time for calcul the mask position with numpy : 0.004500865936279297 nb_pixel_total : 80413 time to create 1 rle with old method : 0.08714413642883301 length of segment : 444 time for calcul the mask position with numpy : 0.0037822723388671875 nb_pixel_total : 102450 time to create 1 rle with old method : 0.11528921127319336 length of segment : 426 time for calcul the mask position with numpy : 0.00061798095703125 nb_pixel_total : 10220 time to create 1 rle with old method : 0.012084245681762695 length of segment : 100 time for calcul the mask position with numpy : 0.005740165710449219 nb_pixel_total : 103063 time to create 1 rle with old method : 0.11057710647583008 length of segment : 467 time for calcul the mask position with numpy : 0.0002586841583251953 nb_pixel_total : 2418 time to create 1 rle with old method : 0.0027031898498535156 length of segment : 77 time for calcul the mask position with numpy : 0.0012004375457763672 nb_pixel_total : 28410 time to create 1 rle with old method : 0.0328981876373291 length of segment : 302 time for calcul the mask position with numpy : 0.003191232681274414 nb_pixel_total : 93920 time to create 1 rle with old method : 0.10213470458984375 length of segment : 483 time for calcul the mask position with numpy : 0.0008828639984130859 nb_pixel_total : 14763 time to create 1 rle with old method : 0.017006635665893555 length of segment : 141 time for calcul the mask position with numpy : 0.00029587745666503906 nb_pixel_total : 1856 time to create 1 rle with old method : 0.002196788787841797 length of segment : 70 time for calcul the mask position with numpy : 0.0006957054138183594 nb_pixel_total : 11700 time to create 1 rle with old method : 0.013949155807495117 length of segment : 84 time for calcul the mask position with numpy : 0.00022077560424804688 nb_pixel_total : 4478 time to create 1 rle with old method : 0.005159854888916016 length of segment : 97 time for calcul the mask position with numpy : 0.0006825923919677734 nb_pixel_total : 9242 time to create 1 rle with old method : 0.010729074478149414 length of segment : 129 time for calcul the mask position with numpy : 0.0004267692565917969 nb_pixel_total : 6699 time to create 1 rle with old method : 0.00939178466796875 length of segment : 107 time for calcul the mask position with numpy : 0.0016617774963378906 nb_pixel_total : 17157 time to create 1 rle with old method : 0.01815629005432129 length of segment : 274 time for calcul the mask position with numpy : 0.0002028942108154297 nb_pixel_total : 2960 time to create 1 rle with old method : 0.0037288665771484375 length of segment : 41 time for calcul the mask position with numpy : 0.0007631778717041016 nb_pixel_total : 6880 time to create 1 rle with old method : 0.007555961608886719 length of segment : 148 time for calcul the mask position with numpy : 0.0004169940948486328 nb_pixel_total : 2629 time to create 1 rle with old method : 0.003103017807006836 length of segment : 75 time for calcul the mask position with numpy : 0.0005698204040527344 nb_pixel_total : 6856 time to create 1 rle with old method : 0.007189035415649414 length of segment : 103 time for calcul the mask position with numpy : 0.0005223751068115234 nb_pixel_total : 7705 time to create 1 rle with old method : 0.009016752243041992 length of segment : 93 time for calcul the mask position with numpy : 0.002252817153930664 nb_pixel_total : 41158 time to create 1 rle with old method : 0.043349266052246094 length of segment : 229 time for calcul the mask position with numpy : 0.0006225109100341797 nb_pixel_total : 6546 time to create 1 rle with old method : 0.007615327835083008 length of segment : 90 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 2075 time to create 1 rle with old method : 0.0025589466094970703 length of segment : 45 time for calcul the mask position with numpy : 0.0006129741668701172 nb_pixel_total : 9502 time to create 1 rle with old method : 0.010351419448852539 length of segment : 145 time for calcul the mask position with numpy : 0.00013065338134765625 nb_pixel_total : 1261 time to create 1 rle with old method : 0.0016970634460449219 length of segment : 42 time for calcul the mask position with numpy : 0.0010831356048583984 nb_pixel_total : 26705 time to create 1 rle with old method : 0.02973484992980957 length of segment : 174 time for calcul the mask position with numpy : 0.0005350112915039062 nb_pixel_total : 7739 time to create 1 rle with old method : 0.009073257446289062 length of segment : 159 time for calcul the mask position with numpy : 0.00017333030700683594 nb_pixel_total : 1847 time to create 1 rle with old method : 0.0024080276489257812 length of segment : 63 time for calcul the mask position with numpy : 0.0047454833984375 nb_pixel_total : 113095 time to create 1 rle with old method : 0.12182378768920898 length of segment : 445 time for calcul the mask position with numpy : 0.0037734508514404297 nb_pixel_total : 92764 time to create 1 rle with old method : 0.09971427917480469 length of segment : 373 time for calcul the mask position with numpy : 0.0007283687591552734 nb_pixel_total : 12415 time to create 1 rle with old method : 0.013339519500732422 length of segment : 194 time for calcul the mask position with numpy : 0.003964424133300781 nb_pixel_total : 97140 time to create 1 rle with old method : 0.10758233070373535 length of segment : 401 time for calcul the mask position with numpy : 0.0031697750091552734 nb_pixel_total : 104955 time to create 1 rle with old method : 0.11701631546020508 length of segment : 389 time for calcul the mask position with numpy : 0.0039255619049072266 nb_pixel_total : 99589 time to create 1 rle with old method : 0.11277413368225098 length of segment : 430 time for calcul the mask position with numpy : 0.0005385875701904297 nb_pixel_total : 8601 time to create 1 rle with old method : 0.00985264778137207 length of segment : 134 time for calcul the mask position with numpy : 0.00022149085998535156 nb_pixel_total : 2006 time to create 1 rle with old method : 0.002343893051147461 length of segment : 74 time for calcul the mask position with numpy : 0.0008890628814697266 nb_pixel_total : 17541 time to create 1 rle with old method : 0.019098281860351562 length of segment : 179 time for calcul the mask position with numpy : 0.00316619873046875 nb_pixel_total : 82045 time to create 1 rle with old method : 0.0916435718536377 length of segment : 386 time for calcul the mask position with numpy : 0.0002548694610595703 nb_pixel_total : 3531 time to create 1 rle with old method : 0.004349946975708008 length of segment : 101 time for calcul the mask position with numpy : 0.0007915496826171875 nb_pixel_total : 14123 time to create 1 rle with old method : 0.016078710556030273 length of segment : 160 time for calcul the mask position with numpy : 0.00040793418884277344 nb_pixel_total : 7278 time to create 1 rle with old method : 0.008705377578735352 length of segment : 107 time for calcul the mask position with numpy : 0.0004048347473144531 nb_pixel_total : 7422 time to create 1 rle with old method : 0.008282899856567383 length of segment : 192 time for calcul the mask position with numpy : 0.00027823448181152344 nb_pixel_total : 4766 time to create 1 rle with old method : 0.005587339401245117 length of segment : 92 time for calcul the mask position with numpy : 0.0005681514739990234 nb_pixel_total : 10025 time to create 1 rle with old method : 0.011512517929077148 length of segment : 105 time for calcul the mask position with numpy : 0.0021979808807373047 nb_pixel_total : 31375 time to create 1 rle with old method : 0.04188084602355957 length of segment : 279 time for calcul the mask position with numpy : 0.0008120536804199219 nb_pixel_total : 11611 time to create 1 rle with old method : 0.018919706344604492 length of segment : 138 time for calcul the mask position with numpy : 0.0002808570861816406 nb_pixel_total : 3018 time to create 1 rle with old method : 0.0035588741302490234 length of segment : 64 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 974 time to create 1 rle with old method : 0.0011777877807617188 length of segment : 50 time for calcul the mask position with numpy : 0.00013184547424316406 nb_pixel_total : 4841 time to create 1 rle with old method : 0.005491018295288086 length of segment : 112 time for calcul the mask position with numpy : 0.0002715587615966797 nb_pixel_total : 4481 time to create 1 rle with old method : 0.005396366119384766 length of segment : 52 time for calcul the mask position with numpy : 0.0003764629364013672 nb_pixel_total : 8513 time to create 1 rle with old method : 0.009490251541137695 length of segment : 159 time for calcul the mask position with numpy : 8.559226989746094e-05 nb_pixel_total : 3050 time to create 1 rle with old method : 0.0035943984985351562 length of segment : 75 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 664 time to create 1 rle with old method : 0.0008711814880371094 length of segment : 49 time for calcul the mask position with numpy : 0.0015735626220703125 nb_pixel_total : 26273 time to create 1 rle with old method : 0.027892351150512695 length of segment : 242 time for calcul the mask position with numpy : 0.0005095005035400391 nb_pixel_total : 6034 time to create 1 rle with old method : 0.010071039199829102 length of segment : 108 time for calcul the mask position with numpy : 0.0004677772521972656 nb_pixel_total : 5485 time to create 1 rle with old method : 0.009061098098754883 length of segment : 98 time for calcul the mask position with numpy : 0.0005156993865966797 nb_pixel_total : 6187 time to create 1 rle with old method : 0.010058403015136719 length of segment : 99 time for calcul the mask position with numpy : 0.0009114742279052734 nb_pixel_total : 10378 time to create 1 rle with old method : 0.012102842330932617 length of segment : 127 time for calcul the mask position with numpy : 0.0005564689636230469 nb_pixel_total : 7165 time to create 1 rle with old method : 0.008522987365722656 length of segment : 179 time for calcul the mask position with numpy : 0.0007736682891845703 nb_pixel_total : 15244 time to create 1 rle with old method : 0.017824411392211914 length of segment : 151 time for calcul the mask position with numpy : 0.00011968612670898438 nb_pixel_total : 1777 time to create 1 rle with old method : 0.0022211074829101562 length of segment : 101 time for calcul the mask position with numpy : 0.0006654262542724609 nb_pixel_total : 17737 time to create 1 rle with old method : 0.019924640655517578 length of segment : 230 time for calcul the mask position with numpy : 0.0051839351654052734 nb_pixel_total : 97498 time to create 1 rle with old method : 0.10444784164428711 length of segment : 371 time for calcul the mask position with numpy : 0.004503726959228516 nb_pixel_total : 91605 time to create 1 rle with old method : 0.10140395164489746 length of segment : 358 time for calcul the mask position with numpy : 0.004220008850097656 nb_pixel_total : 100508 time to create 1 rle with old method : 0.1112067699432373 length of segment : 396 time for calcul the mask position with numpy : 0.0009827613830566406 nb_pixel_total : 14072 time to create 1 rle with old method : 0.01593804359436035 length of segment : 208 time for calcul the mask position with numpy : 0.003793478012084961 nb_pixel_total : 105083 time to create 1 rle with old method : 0.12949514389038086 length of segment : 456 time for calcul the mask position with numpy : 0.0005936622619628906 nb_pixel_total : 8564 time to create 1 rle with old method : 0.00999307632446289 length of segment : 119 time for calcul the mask position with numpy : 0.0011205673217773438 nb_pixel_total : 15862 time to create 1 rle with old method : 0.019220829010009766 length of segment : 174 time for calcul the mask position with numpy : 0.004701375961303711 nb_pixel_total : 88953 time to create 1 rle with old method : 0.10194158554077148 length of segment : 443 time for calcul the mask position with numpy : 0.003960847854614258 nb_pixel_total : 82267 time to create 1 rle with old method : 0.09956049919128418 length of segment : 389 time for calcul the mask position with numpy : 0.0003981590270996094 nb_pixel_total : 3142 time to create 1 rle with old method : 0.004130840301513672 length of segment : 66 time for calcul the mask position with numpy : 0.000591278076171875 nb_pixel_total : 7725 time to create 1 rle with old method : 0.009282350540161133 length of segment : 126 time for calcul the mask position with numpy : 0.0002875328063964844 nb_pixel_total : 1938 time to create 1 rle with old method : 0.0026090145111083984 length of segment : 72 time for calcul the mask position with numpy : 0.0011119842529296875 nb_pixel_total : 14401 time to create 1 rle with old method : 0.018672704696655273 length of segment : 135 time for calcul the mask position with numpy : 0.0007658004760742188 nb_pixel_total : 11001 time to create 1 rle with old method : 0.013076305389404297 length of segment : 205 time for calcul the mask position with numpy : 0.0008213520050048828 nb_pixel_total : 11811 time to create 1 rle with old method : 0.013358592987060547 length of segment : 109 time for calcul the mask position with numpy : 0.00021457672119140625 nb_pixel_total : 3862 time to create 1 rle with old method : 0.004805803298950195 length of segment : 46 time for calcul the mask position with numpy : 0.001544952392578125 nb_pixel_total : 20443 time to create 1 rle with old method : 0.023997068405151367 length of segment : 314 time for calcul the mask position with numpy : 0.00013494491577148438 nb_pixel_total : 3739 time to create 1 rle with old method : 0.004325389862060547 length of segment : 113 time for calcul the mask position with numpy : 0.0002124309539794922 nb_pixel_total : 2732 time to create 1 rle with old method : 0.0033304691314697266 length of segment : 60 time for calcul the mask position with numpy : 0.0006351470947265625 nb_pixel_total : 19150 time to create 1 rle with old method : 0.021257877349853516 length of segment : 216 time for calcul the mask position with numpy : 0.0007951259613037109 nb_pixel_total : 11224 time to create 1 rle with old method : 0.012969017028808594 length of segment : 164 time for calcul the mask position with numpy : 0.0004825592041015625 nb_pixel_total : 6282 time to create 1 rle with old method : 0.007164716720581055 length of segment : 92 time for calcul the mask position with numpy : 0.0021185874938964844 nb_pixel_total : 31065 time to create 1 rle with old method : 0.036287784576416016 length of segment : 256 time for calcul the mask position with numpy : 0.0009992122650146484 nb_pixel_total : 21406 time to create 1 rle with old method : 0.024221181869506836 length of segment : 174 time for calcul the mask position with numpy : 0.00010466575622558594 nb_pixel_total : 1134 time to create 1 rle with old method : 0.0014355182647705078 length of segment : 38 time for calcul the mask position with numpy : 0.0002453327178955078 nb_pixel_total : 4525 time to create 1 rle with old method : 0.005165576934814453 length of segment : 86 time for calcul the mask position with numpy : 0.0010259151458740234 nb_pixel_total : 21792 time to create 1 rle with old method : 0.025956153869628906 length of segment : 163 time for calcul the mask position with numpy : 0.0008893013000488281 nb_pixel_total : 13949 time to create 1 rle with old method : 0.01623392105102539 length of segment : 172 time for calcul the mask position with numpy : 0.000164031982421875 nb_pixel_total : 5890 time to create 1 rle with old method : 0.0073146820068359375 length of segment : 98 time for calcul the mask position with numpy : 0.0008456707000732422 nb_pixel_total : 13185 time to create 1 rle with old method : 0.015158891677856445 length of segment : 153 time for calcul the mask position with numpy : 0.00017189979553222656 nb_pixel_total : 4183 time to create 1 rle with old method : 0.0051403045654296875 length of segment : 86 time for calcul the mask position with numpy : 0.00027060508728027344 nb_pixel_total : 5727 time to create 1 rle with old method : 0.006992816925048828 length of segment : 103 time for calcul the mask position with numpy : 0.0005733966827392578 nb_pixel_total : 13421 time to create 1 rle with old method : 0.016287565231323242 length of segment : 68 time for calcul the mask position with numpy : 0.00028133392333984375 nb_pixel_total : 5598 time to create 1 rle with old method : 0.0068378448486328125 length of segment : 93 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 806 time to create 1 rle with old method : 0.0010409355163574219 length of segment : 46 time for calcul the mask position with numpy : 0.0001819133758544922 nb_pixel_total : 2617 time to create 1 rle with old method : 0.0034170150756835938 length of segment : 38 time for calcul the mask position with numpy : 0.0006256103515625 nb_pixel_total : 13527 time to create 1 rle with old method : 0.01582813262939453 length of segment : 137 time for calcul the mask position with numpy : 0.000431060791015625 nb_pixel_total : 11363 time to create 1 rle with old method : 0.01262354850769043 length of segment : 217 time for calcul the mask position with numpy : 0.0002071857452392578 nb_pixel_total : 4252 time to create 1 rle with old method : 0.005160331726074219 length of segment : 86 time for calcul the mask position with numpy : 0.005722761154174805 nb_pixel_total : 141660 time to create 1 rle with old method : 0.15424370765686035 length of segment : 492 time for calcul the mask position with numpy : 0.00013637542724609375 nb_pixel_total : 1450 time to create 1 rle with old method : 0.0018401145935058594 length of segment : 52 time for calcul the mask position with numpy : 0.0029358863830566406 nb_pixel_total : 84594 time to create 1 rle with old method : 0.09311079978942871 length of segment : 353 time for calcul the mask position with numpy : 0.0004584789276123047 nb_pixel_total : 6174 time to create 1 rle with old method : 0.00813603401184082 length of segment : 86 time for calcul the mask position with numpy : 0.002887725830078125 nb_pixel_total : 92610 time to create 1 rle with old method : 0.11531591415405273 length of segment : 414 time for calcul the mask position with numpy : 0.002626657485961914 nb_pixel_total : 68311 time to create 1 rle with old method : 0.07408976554870605 length of segment : 504 time for calcul the mask position with numpy : 0.002791881561279297 nb_pixel_total : 95587 time to create 1 rle with old method : 0.1007988452911377 length of segment : 413 time for calcul the mask position with numpy : 0.0005373954772949219 nb_pixel_total : 8326 time to create 1 rle with old method : 0.009918212890625 length of segment : 125 time for calcul the mask position with numpy : 0.0007126331329345703 nb_pixel_total : 18332 time to create 1 rle with old method : 0.022128582000732422 length of segment : 154 time for calcul the mask position with numpy : 0.0004506111145019531 nb_pixel_total : 20706 time to create 1 rle with old method : 0.024472475051879883 length of segment : 168 time for calcul the mask position with numpy : 0.00016951560974121094 nb_pixel_total : 2528 time to create 1 rle with old method : 0.0030286312103271484 length of segment : 59 time for calcul the mask position with numpy : 0.00010585784912109375 nb_pixel_total : 869 time to create 1 rle with old method : 0.0010836124420166016 length of segment : 38 time for calcul the mask position with numpy : 0.004784584045410156 nb_pixel_total : 157619 time to create 1 rle with new method : 0.007277011871337891 length of segment : 525 time for calcul the mask position with numpy : 0.00023937225341796875 nb_pixel_total : 3654 time to create 1 rle with old method : 0.0043792724609375 length of segment : 79 time for calcul the mask position with numpy : 0.00030493736267089844 nb_pixel_total : 7653 time to create 1 rle with old method : 0.009042501449584961 length of segment : 82 time for calcul the mask position with numpy : 0.0002372264862060547 nb_pixel_total : 8855 time to create 1 rle with old method : 0.010345220565795898 length of segment : 168 time for calcul the mask position with numpy : 0.00011849403381347656 nb_pixel_total : 3849 time to create 1 rle with old method : 0.0044403076171875 length of segment : 95 time for calcul the mask position with numpy : 0.00045108795166015625 nb_pixel_total : 8550 time to create 1 rle with old method : 0.010080337524414062 length of segment : 90 time for calcul the mask position with numpy : 0.0005044937133789062 nb_pixel_total : 10511 time to create 1 rle with old method : 0.012314081192016602 length of segment : 121 time for calcul the mask position with numpy : 0.00015687942504882812 nb_pixel_total : 1320 time to create 1 rle with old method : 0.001794576644897461 length of segment : 47 time for calcul the mask position with numpy : 0.0005431175231933594 nb_pixel_total : 11683 time to create 1 rle with old method : 0.013514995574951172 length of segment : 114 time for calcul the mask position with numpy : 0.0006051063537597656 nb_pixel_total : 11936 time to create 1 rle with old method : 0.013489484786987305 length of segment : 143 time for calcul the mask position with numpy : 0.0004489421844482422 nb_pixel_total : 9698 time to create 1 rle with old method : 0.011271238327026367 length of segment : 136 time for calcul the mask position with numpy : 0.0001926422119140625 nb_pixel_total : 3917 time to create 1 rle with old method : 0.004674434661865234 length of segment : 87 time for calcul the mask position with numpy : 0.0015668869018554688 nb_pixel_total : 18691 time to create 1 rle with old method : 0.022322893142700195 length of segment : 306 time for calcul the mask position with numpy : 0.00022530555725097656 nb_pixel_total : 2420 time to create 1 rle with old method : 0.0029480457305908203 length of segment : 80 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 641 time to create 1 rle with old method : 0.0008776187896728516 length of segment : 35 time for calcul the mask position with numpy : 0.0038628578186035156 nb_pixel_total : 98380 time to create 1 rle with old method : 0.1197347640991211 length of segment : 363 time for calcul the mask position with numpy : 0.004358053207397461 nb_pixel_total : 103471 time to create 1 rle with old method : 0.11628198623657227 length of segment : 416 time for calcul the mask position with numpy : 0.0001709461212158203 nb_pixel_total : 1653 time to create 1 rle with old method : 0.0020754337310791016 length of segment : 40 time for calcul the mask position with numpy : 0.003626585006713867 nb_pixel_total : 103597 time to create 1 rle with old method : 0.11377835273742676 length of segment : 382 time for calcul the mask position with numpy : 0.0034263134002685547 nb_pixel_total : 93664 time to create 1 rle with old method : 0.12921357154846191 length of segment : 373 time for calcul the mask position with numpy : 0.0034322738647460938 nb_pixel_total : 98568 time to create 1 rle with old method : 0.11415648460388184 length of segment : 441 time for calcul the mask position with numpy : 0.0009009838104248047 nb_pixel_total : 5416 time to create 1 rle with old method : 0.009041070938110352 length of segment : 126 time for calcul the mask position with numpy : 0.0009586811065673828 nb_pixel_total : 10352 time to create 1 rle with old method : 0.012810468673706055 length of segment : 128 time for calcul the mask position with numpy : 0.0002357959747314453 nb_pixel_total : 1957 time to create 1 rle with old method : 0.0024678707122802734 length of segment : 107 time for calcul the mask position with numpy : 0.00039124488830566406 nb_pixel_total : 5251 time to create 1 rle with old method : 0.006452083587646484 length of segment : 149 time for calcul the mask position with numpy : 0.001140594482421875 nb_pixel_total : 16944 time to create 1 rle with old method : 0.02010822296142578 length of segment : 193 time for calcul the mask position with numpy : 0.0001366138458251953 nb_pixel_total : 623 time to create 1 rle with old method : 0.0008943080902099609 length of segment : 38 time for calcul the mask position with numpy : 0.00037670135498046875 nb_pixel_total : 1699 time to create 1 rle with old method : 0.0021805763244628906 length of segment : 115 time for calcul the mask position with numpy : 8.654594421386719e-05 nb_pixel_total : 1922 time to create 1 rle with old method : 0.0023539066314697266 length of segment : 85 time for calcul the mask position with numpy : 0.00028896331787109375 nb_pixel_total : 2794 time to create 1 rle with old method : 0.00335693359375 length of segment : 83 time for calcul the mask position with numpy : 0.0027954578399658203 nb_pixel_total : 76283 time to create 1 rle with old method : 0.0908362865447998 length of segment : 490 time for calcul the mask position with numpy : 0.0008070468902587891 nb_pixel_total : 16193 time to create 1 rle with old method : 0.019171953201293945 length of segment : 161 time for calcul the mask position with numpy : 0.0003101825714111328 nb_pixel_total : 8673 time to create 1 rle with old method : 0.010529756546020508 length of segment : 107 time for calcul the mask position with numpy : 0.00018334388732910156 nb_pixel_total : 2575 time to create 1 rle with old method : 0.003259897232055664 length of segment : 60 time for calcul the mask position with numpy : 0.0001850128173828125 nb_pixel_total : 2457 time to create 1 rle with old method : 0.003022909164428711 length of segment : 93 time for calcul the mask position with numpy : 0.00027561187744140625 nb_pixel_total : 4189 time to create 1 rle with old method : 0.005084037780761719 length of segment : 94 time for calcul the mask position with numpy : 0.0008928775787353516 nb_pixel_total : 15012 time to create 1 rle with old method : 0.01758289337158203 length of segment : 153 time for calcul the mask position with numpy : 0.0003075599670410156 nb_pixel_total : 3631 time to create 1 rle with old method : 0.004204750061035156 length of segment : 73 time for calcul the mask position with numpy : 0.0007944107055664062 nb_pixel_total : 12462 time to create 1 rle with old method : 0.013691425323486328 length of segment : 157 time for calcul the mask position with numpy : 0.0003190040588378906 nb_pixel_total : 6414 time to create 1 rle with old method : 0.007600545883178711 length of segment : 87 time for calcul the mask position with numpy : 0.0008175373077392578 nb_pixel_total : 13338 time to create 1 rle with old method : 0.015226602554321289 length of segment : 209 time for calcul the mask position with numpy : 0.0003528594970703125 nb_pixel_total : 3243 time to create 1 rle with old method : 0.004158735275268555 length of segment : 113 time for calcul the mask position with numpy : 0.0006422996520996094 nb_pixel_total : 11299 time to create 1 rle with old method : 0.013096094131469727 length of segment : 123 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 1432 time to create 1 rle with old method : 0.001691579818725586 length of segment : 69 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 1080 time to create 1 rle with old method : 0.0013592243194580078 length of segment : 31 time for calcul the mask position with numpy : 0.00032138824462890625 nb_pixel_total : 5883 time to create 1 rle with old method : 0.007327556610107422 length of segment : 80 time for calcul the mask position with numpy : 0.0006988048553466797 nb_pixel_total : 15170 time to create 1 rle with old method : 0.017336130142211914 length of segment : 139 time for calcul the mask position with numpy : 0.0036172866821289062 nb_pixel_total : 93536 time to create 1 rle with old method : 0.10945320129394531 length of segment : 394 time for calcul the mask position with numpy : 0.0038242340087890625 nb_pixel_total : 96948 time to create 1 rle with old method : 0.11197066307067871 length of segment : 419 time for calcul the mask position with numpy : 0.0055484771728515625 nb_pixel_total : 90774 time to create 1 rle with old method : 0.14131760597229004 length of segment : 378 time for calcul the mask position with numpy : 0.0005991458892822266 nb_pixel_total : 6763 time to create 1 rle with old method : 0.011278867721557617 length of segment : 109 time for calcul the mask position with numpy : 0.004250526428222656 nb_pixel_total : 94465 time to create 1 rle with old method : 0.14830660820007324 length of segment : 489 time for calcul the mask position with numpy : 0.0042951107025146484 nb_pixel_total : 104605 time to create 1 rle with old method : 0.12898993492126465 length of segment : 434 time for calcul the mask position with numpy : 0.00043272972106933594 nb_pixel_total : 5979 time to create 1 rle with old method : 0.0071544647216796875 length of segment : 105 time for calcul the mask position with numpy : 0.0006425380706787109 nb_pixel_total : 5898 time to create 1 rle with old method : 0.007836580276489258 length of segment : 197 time for calcul the mask position with numpy : 0.0008022785186767578 nb_pixel_total : 19829 time to create 1 rle with old method : 0.023213624954223633 length of segment : 178 time for calcul the mask position with numpy : 0.0008435249328613281 nb_pixel_total : 12041 time to create 1 rle with old method : 0.014523029327392578 length of segment : 146 time for calcul the mask position with numpy : 0.00044035911560058594 nb_pixel_total : 12222 time to create 1 rle with old method : 0.014312267303466797 length of segment : 125 time for calcul the mask position with numpy : 0.0004868507385253906 nb_pixel_total : 10987 time to create 1 rle with old method : 0.013579607009887695 length of segment : 116 time for calcul the mask position with numpy : 0.001859903335571289 nb_pixel_total : 28733 time to create 1 rle with old method : 0.033135414123535156 length of segment : 167 time for calcul the mask position with numpy : 0.0021958351135253906 nb_pixel_total : 87377 time to create 1 rle with old method : 0.10156726837158203 length of segment : 488 time for calcul the mask position with numpy : 0.0002911090850830078 nb_pixel_total : 6351 time to create 1 rle with old method : 0.007925033569335938 length of segment : 84 time for calcul the mask position with numpy : 0.00010824203491210938 nb_pixel_total : 654 time to create 1 rle with old method : 0.0009484291076660156 length of segment : 32 time for calcul the mask position with numpy : 0.0033311843872070312 nb_pixel_total : 67701 time to create 1 rle with old method : 0.07799696922302246 length of segment : 330 time for calcul the mask position with numpy : 0.00030803680419921875 nb_pixel_total : 5541 time to create 1 rle with old method : 0.006859302520751953 length of segment : 107 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 416 time to create 1 rle with old method : 0.0005462169647216797 length of segment : 25 time for calcul the mask position with numpy : 0.0008428096771240234 nb_pixel_total : 16919 time to create 1 rle with old method : 0.02086162567138672 length of segment : 184 time for calcul the mask position with numpy : 0.0006783008575439453 nb_pixel_total : 14086 time to create 1 rle with old method : 0.01643681526184082 length of segment : 176 time for calcul the mask position with numpy : 0.00037932395935058594 nb_pixel_total : 8897 time to create 1 rle with old method : 0.010805368423461914 length of segment : 168 time for calcul the mask position with numpy : 0.00016379356384277344 nb_pixel_total : 4652 time to create 1 rle with old method : 0.0060040950775146484 length of segment : 94 time for calcul the mask position with numpy : 0.00047707557678222656 nb_pixel_total : 9483 time to create 1 rle with old method : 0.012188434600830078 length of segment : 133 time for calcul the mask position with numpy : 0.00031638145446777344 nb_pixel_total : 5592 time to create 1 rle with old method : 0.006630897521972656 length of segment : 101 time for calcul the mask position with numpy : 8.988380432128906e-05 nb_pixel_total : 1022 time to create 1 rle with old method : 0.0013017654418945312 length of segment : 43 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 2052 time to create 1 rle with old method : 0.0025582313537597656 length of segment : 88 time for calcul the mask position with numpy : 0.00047516822814941406 nb_pixel_total : 14429 time to create 1 rle with old method : 0.016209840774536133 length of segment : 120 time for calcul the mask position with numpy : 0.0009932518005371094 nb_pixel_total : 16740 time to create 1 rle with old method : 0.018507003784179688 length of segment : 239 time for calcul the mask position with numpy : 0.00022339820861816406 nb_pixel_total : 4221 time to create 1 rle with old method : 0.005107879638671875 length of segment : 91 time for calcul the mask position with numpy : 9.703636169433594e-05 nb_pixel_total : 4035 time to create 1 rle with old method : 0.004983186721801758 length of segment : 62 time for calcul the mask position with numpy : 0.0002644062042236328 nb_pixel_total : 7785 time to create 1 rle with old method : 0.008858680725097656 length of segment : 228 time for calcul the mask position with numpy : 0.000438690185546875 nb_pixel_total : 8740 time to create 1 rle with old method : 0.009713411331176758 length of segment : 170 time for calcul the mask position with numpy : 0.00021839141845703125 nb_pixel_total : 7384 time to create 1 rle with old method : 0.008655548095703125 length of segment : 62 time for calcul the mask position with numpy : 0.00016951560974121094 nb_pixel_total : 2817 time to create 1 rle with old method : 0.0034334659576416016 length of segment : 80 time for calcul the mask position with numpy : 0.0002701282501220703 nb_pixel_total : 7497 time to create 1 rle with old method : 0.008832454681396484 length of segment : 91 time for calcul the mask position with numpy : 0.0008411407470703125 nb_pixel_total : 8901 time to create 1 rle with old method : 0.010427474975585938 length of segment : 217 time for calcul the mask position with numpy : 0.0002739429473876953 nb_pixel_total : 3789 time to create 1 rle with old method : 0.004896879196166992 length of segment : 123 time for calcul the mask position with numpy : 0.00025177001953125 nb_pixel_total : 4104 time to create 1 rle with old method : 0.005228281021118164 length of segment : 96 time for calcul the mask position with numpy : 0.00011038780212402344 nb_pixel_total : 374 time to create 1 rle with old method : 0.0005340576171875 length of segment : 27 time for calcul the mask position with numpy : 0.00022721290588378906 nb_pixel_total : 3612 time to create 1 rle with old method : 0.0045413970947265625 length of segment : 76 time for calcul the mask position with numpy : 0.0002827644348144531 nb_pixel_total : 4753 time to create 1 rle with old method : 0.006085395812988281 length of segment : 60 time for calcul the mask position with numpy : 0.00040841102600097656 nb_pixel_total : 14412 time to create 1 rle with old method : 0.017003774642944336 length of segment : 151 time for calcul the mask position with numpy : 0.00021886825561523438 nb_pixel_total : 4148 time to create 1 rle with old method : 0.005108833312988281 length of segment : 84 time for calcul the mask position with numpy : 0.0034723281860351562 nb_pixel_total : 93166 time to create 1 rle with old method : 0.10498571395874023 length of segment : 344 time for calcul the mask position with numpy : 0.0044782161712646484 nb_pixel_total : 108210 time to create 1 rle with old method : 0.12018156051635742 length of segment : 512 time for calcul the mask position with numpy : 0.004029750823974609 nb_pixel_total : 90714 time to create 1 rle with old method : 0.10232973098754883 length of segment : 393 time for calcul the mask position with numpy : 0.0010099411010742188 nb_pixel_total : 19509 time to create 1 rle with old method : 0.022874116897583008 length of segment : 194 time for calcul the mask position with numpy : 0.003046751022338867 nb_pixel_total : 79495 time to create 1 rle with old method : 0.0893101692199707 length of segment : 336 time for calcul the mask position with numpy : 0.0007669925689697266 nb_pixel_total : 15261 time to create 1 rle with old method : 0.01789259910583496 length of segment : 116 time for calcul the mask position with numpy : 0.0031952857971191406 nb_pixel_total : 80828 time to create 1 rle with old method : 0.1048128604888916 length of segment : 446 time for calcul the mask position with numpy : 0.0012543201446533203 nb_pixel_total : 12958 time to create 1 rle with old method : 0.023645401000976562 length of segment : 215 time for calcul the mask position with numpy : 0.00038504600524902344 nb_pixel_total : 3604 time to create 1 rle with old method : 0.004867076873779297 length of segment : 72 time for calcul the mask position with numpy : 0.0010173320770263672 nb_pixel_total : 19511 time to create 1 rle with old method : 0.02449774742126465 length of segment : 240 time for calcul the mask position with numpy : 0.002222776412963867 nb_pixel_total : 46265 time to create 1 rle with old method : 0.05305647850036621 length of segment : 214 time for calcul the mask position with numpy : 0.0004544258117675781 nb_pixel_total : 5348 time to create 1 rle with old method : 0.006707191467285156 length of segment : 102 time for calcul the mask position with numpy : 0.0002765655517578125 nb_pixel_total : 12531 time to create 1 rle with old method : 0.015114545822143555 length of segment : 159 time for calcul the mask position with numpy : 0.0026769638061523438 nb_pixel_total : 49272 time to create 1 rle with old method : 0.05746889114379883 length of segment : 224 time for calcul the mask position with numpy : 0.0007867813110351562 nb_pixel_total : 13084 time to create 1 rle with old method : 0.01732921600341797 length of segment : 126 time for calcul the mask position with numpy : 0.0004661083221435547 nb_pixel_total : 7642 time to create 1 rle with old method : 0.009233474731445312 length of segment : 76 time for calcul the mask position with numpy : 0.0012431144714355469 nb_pixel_total : 14065 time to create 1 rle with old method : 0.016512155532836914 length of segment : 317 time for calcul the mask position with numpy : 0.00010514259338378906 nb_pixel_total : 3292 time to create 1 rle with old method : 0.004071235656738281 length of segment : 71 time for calcul the mask position with numpy : 0.000431060791015625 nb_pixel_total : 7262 time to create 1 rle with old method : 0.009035348892211914 length of segment : 122 time for calcul the mask position with numpy : 0.00018835067749023438 nb_pixel_total : 7250 time to create 1 rle with old method : 0.009896993637084961 length of segment : 92 time for calcul the mask position with numpy : 0.0002968311309814453 nb_pixel_total : 8440 time to create 1 rle with old method : 0.010419368743896484 length of segment : 243 time for calcul the mask position with numpy : 0.0006506443023681641 nb_pixel_total : 5707 time to create 1 rle with old method : 0.007434368133544922 length of segment : 108 time for calcul the mask position with numpy : 0.0006678104400634766 nb_pixel_total : 11850 time to create 1 rle with old method : 0.014122486114501953 length of segment : 130 time for calcul the mask position with numpy : 0.0006761550903320312 nb_pixel_total : 6094 time to create 1 rle with old method : 0.007581233978271484 length of segment : 235 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 2254 time to create 1 rle with old method : 0.0027251243591308594 length of segment : 89 time for calcul the mask position with numpy : 0.00042557716369628906 nb_pixel_total : 10385 time to create 1 rle with old method : 0.012597799301147461 length of segment : 112 time for calcul the mask position with numpy : 0.0013048648834228516 nb_pixel_total : 23734 time to create 1 rle with old method : 0.02808070182800293 length of segment : 168 time for calcul the mask position with numpy : 0.00027489662170410156 nb_pixel_total : 13106 time to create 1 rle with old method : 0.01573467254638672 length of segment : 131 time for calcul the mask position with numpy : 0.00014781951904296875 nb_pixel_total : 7091 time to create 1 rle with old method : 0.00856924057006836 length of segment : 98 time for calcul the mask position with numpy : 0.002156496047973633 nb_pixel_total : 39399 time to create 1 rle with old method : 0.04432201385498047 length of segment : 279 time for calcul the mask position with numpy : 0.00021958351135253906 nb_pixel_total : 3173 time to create 1 rle with old method : 0.003881692886352539 length of segment : 88 time for calcul the mask position with numpy : 0.0004570484161376953 nb_pixel_total : 7444 time to create 1 rle with old method : 0.008985519409179688 length of segment : 149 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 525 time to create 1 rle with old method : 0.0006823539733886719 length of segment : 31 time for calcul the mask position with numpy : 0.0027916431427001953 nb_pixel_total : 96083 time to create 1 rle with old method : 0.12107396125793457 length of segment : 574 time for calcul the mask position with numpy : 0.0006020069122314453 nb_pixel_total : 12742 time to create 1 rle with old method : 0.014646768569946289 length of segment : 152 time spent for convertir_results : 16.917072534561157 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 358 chid ids of type : 3760 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 59652 save missing photos in datou_result : time spend for datou_step_exec : 61.41915965080261 time spend to save output : 6.4021687507629395 total time spend for step 1 : 67.82132840156555 step2:blur_detection Sat Feb 1 02:05:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 10 time used for this insertion : 0.010762453079223633 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 10 time used for this insertion : 1.423940896987915 save missing photos in datou_result : time spend for datou_step_exec : 0.5490412712097168 time spend to save output : 1.4391486644744873 total time spend for step 2 : 1.988189935684204 step3:brightness Sat Feb 1 02:05:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 10 time used for this insertion : 0.14422392845153809 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 10 time used for this insertion : 0.009803533554077148 save missing photos in datou_result : time spend for datou_step_exec : 0.30286622047424316 time spend to save output : 0.15842437744140625 total time spend for step 3 : 0.4612905979156494 step4:crop_condition Sat Feb 1 02:05:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3760 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 358 chid ids of type : 3760 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : barquette param for this class : {'min_score': 0.7} filtre for class : barquette hashtag_id of this class : 492787675 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 35 About to insert : list_path_to_insert length 35 new photo from crops ! About to upload 35 photos upload in portfolio : 4219792 init cache_photo without model_param we have 35 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738371942_2640705 we have uploaded 35 photos in the portfolio 4219792 time of upload the photos Elapsed time : 11.186016321182251 we have finished the crop for the class : barquette begin to crop the class : fibreux_cont param for this class : {'min_score': 0.7} filtre for class : fibreux_cont hashtag_id of this class : 2107756748 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 25 About to insert : list_path_to_insert length 25 new photo from crops ! About to upload 25 photos upload in portfolio : 4219792 init cache_photo without model_param we have 25 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738371955_2640705 we have uploaded 25 photos in the portfolio 4219792 time of upload the photos Elapsed time : 6.2344067096710205 we have finished the crop for the class : fibreux_cont begin to crop the class : film_plastique param for this class : {'min_score': 0.7} filtre for class : film_plastique hashtag_id of this class : 2107756122 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 4219792 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738371962_2640705 we have uploaded 8 photos in the portfolio 4219792 time of upload the photos Elapsed time : 3.526639223098755 we have finished the crop for the class : film_plastique begin to crop the class : autre_contaminant param for this class : {'min_score': 0.7} filtre for class : autre_contaminant hashtag_id of this class : 2107756781 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 97 About to insert : list_path_to_insert length 97 new photo from crops ! About to upload 97 photos upload in portfolio : 4219792 init cache_photo without model_param we have 97 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738371970_2640705 we have uploaded 97 photos in the portfolio 4219792 time of upload the photos Elapsed time : 23.175642251968384 we have finished the crop for the class : autre_contaminant begin to crop the class : etiquette_detachee param for this class : {'min_score': 0.7} filtre for class : etiquette_detachee hashtag_id of this class : 2107756860 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 4219792 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738371994_2640705 we have uploaded 6 photos in the portfolio 4219792 time of upload the photos Elapsed time : 1.939124345779419 we have finished the crop for the class : etiquette_detachee begin to crop the class : pet_clair_cont param for this class : {'min_score': 0.7} filtre for class : pet_clair_cont hashtag_id of this class : 2107758154 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! About to upload 17 photos upload in portfolio : 4219792 init cache_photo without model_param we have 17 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738371997_2640705 we have uploaded 17 photos in the portfolio 4219792 time of upload the photos Elapsed time : 4.368444442749023 we have finished the crop for the class : pet_clair_cont begin to crop the class : metal_cont param for this class : {'min_score': 0.7} filtre for class : metal_cont hashtag_id of this class : 2107756749 begin to crop the class : pet_fonce_cont param for this class : {'min_score': 0.7} filtre for class : pet_fonce_cont hashtag_id of this class : 2107758155 begin to crop the class : pet_opaque_cont param for this class : {'min_score': 0.7} filtre for class : pet_opaque_cont hashtag_id of this class : 2107758156 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 45 About to insert : list_path_to_insert length 45 new photo from crops ! About to upload 45 photos upload in portfolio : 4219792 init cache_photo without model_param we have 45 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738372004_2640705 we have uploaded 45 photos in the portfolio 4219792 time of upload the photos Elapsed time : 12.271514892578125 we have finished the crop for the class : pet_opaque_cont delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1330317086, 1330317082, 1330317079, 1330317076, 1330317073, 1330317070, 1330317036, 1330317028, 1330317014, 1330317011] Looping around the photos to save general results len do output : 233 /1333547040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547055Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547058Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547062Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317086', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317082', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317079', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317076', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317073', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317070', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317036', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317028', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317014', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317011', None, None, None, None, None, '2533520') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 709 time used for this insertion : 0.5535132884979248 save_final save missing photos in datou_result : time spend for datou_step_exec : 80.02546501159668 time spend to save output : 0.5592458248138428 total time spend for step 4 : 80.58471083641052 step5:thcl Sat Feb 1 02:06:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3233 time to import caffe and check if the image exist : 0.022674560546875 time to convert the images to numpy array : 0.10570955276489258 time to import caffe and check if the image exist : 0.01690673828125 time to convert the images to numpy array : 0.1176908016204834 time to import caffe and check if the image exist : 0.031096458435058594 time to convert the images to numpy array : 0.1043558120727539 time to import caffe and check if the image exist : 0.025821208953857422 time to convert the images to numpy array : 0.11011028289794922 time to import caffe and check if the image exist : 0.014571189880371094 time to convert the images to numpy array : 0.12302827835083008 time to import caffe and check if the image exist : 0.01946091651916504 time to convert the images to numpy array : 0.1223304271697998 time to import caffe and check if the image exist : 0.02521800994873047 time to convert the images to numpy array : 0.11768627166748047 time to import caffe and check if the image exist : 0.02400374412536621 time to convert the images to numpy array : 0.12130260467529297 time to import caffe and check if the image exist : 0.025657176971435547 time to convert the images to numpy array : 0.12088656425476074 time to import caffe and check if the image exist : 0.020577192306518555 time to convert the images to numpy array : 0.13475680351257324 total time to convert the images to numpy array : 0.48520755767822266 list photo_ids error: [] list photo_ids correct : [1333547226, 1333547227, 1333547228, 1333547229, 1333547230, 1333547231, 1333547232, 1333547233, 1333547234, 1333547235, 1333547236, 1333547237, 1333547238, 1333547239, 1333547240, 1333547241, 1333547242, 1333547243, 1333547244, 1333547245, 1333547246, 1333547247, 1333547248, 1333547249, 1333547375, 1333547376, 1333547377, 1333547378, 1333547379, 1333547381, 1333547382, 1333547383, 1333547384, 1333547385, 1333547386, 1333547387, 1333547388, 1333547389, 1333547390, 1333547392, 1333547393, 1333547251, 1333547252, 1333547253, 1333547254, 1333547255, 1333547256, 1333547257, 1333547258, 1333547260, 1333547261, 1333547262, 1333547263, 1333547264, 1333547265, 1333547267, 1333547268, 1333547269, 1333547270, 1333547271, 1333547273, 1333547274, 1333547275, 1333547276, 1333547277, 1333547174, 1333547175, 1333547176, 1333547177, 1333547178, 1333547179, 1333547180, 1333547181, 1333547182, 1333547183, 1333547184, 1333547185, 1333547186, 1333547187, 1333547188, 1333547190, 1333547191, 1333547192, 1333547193, 1333547194, 1333547195, 1333547197, 1333547198, 1333547199, 1333547092, 1333547096, 1333547098, 1333547099, 1333547100, 1333547101, 1333547102, 1333547103, 1333547104, 1333547105, 1333547106, 1333547111, 1333547112, 1333547113, 1333547114, 1333547115, 1333547116, 1333547117, 1333547118, 1333547119, 1333547120, 1333547121, 1333547122, 1333547123, 1333547350, 1333547351, 1333547352, 1333547353, 1333547354, 1333547355, 1333547356, 1333547357, 1333547358, 1333547359, 1333547360, 1333547361, 1333547363, 1333547364, 1333547365, 1333547366, 1333547367, 1333547368, 1333547369, 1333547370, 1333547371, 1333547372, 1333547373, 1333547374, 1333547278, 1333547279, 1333547280, 1333547286, 1333547287, 1333547288, 1333547289, 1333547290, 1333547291, 1333547292, 1333547293, 1333547295, 1333547296, 1333547297, 1333547298, 1333547299, 1333547300, 1333547301, 1333547302, 1333547303, 1333547346, 1333547347, 1333547348, 1333547349, 1333547200, 1333547201, 1333547202, 1333547203, 1333547204, 1333547205, 1333547207, 1333547208, 1333547209, 1333547210, 1333547212, 1333547213, 1333547214, 1333547215, 1333547216, 1333547217, 1333547218, 1333547219, 1333547220, 1333547221, 1333547222, 1333547223, 1333547224, 1333547225, 1333547124, 1333547125, 1333547126, 1333547127, 1333547128, 1333547129, 1333547130, 1333547131, 1333547132, 1333547133, 1333547134, 1333547135, 1333547148, 1333547149, 1333547150, 1333547151, 1333547152, 1333547153, 1333547154, 1333547155, 1333547170, 1333547171, 1333547172, 1333547173, 1333547040, 1333547041, 1333547042, 1333547043, 1333547044, 1333547045, 1333547046, 1333547047, 1333547048, 1333547049, 1333547052, 1333547055, 1333547058, 1333547062, 1333547065, 1333547068, 1333547071, 1333547074, 1333547078, 1333547081, 1333547084, 1333547085, 1333547086, 1333547089] number of photos to traite : 233 try to delete the photos incorrect in DB tagging for thcl : 3233 To do loadFromThcl(), then load ParamDescType : thcl3233 thcls : [{'id': 3233, 'mtr_user_id': 31, 'name': 'learn_generique_01122021_6000_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'barquette_opaque,carton,ela,environnement,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_fonce,pet_opaque,textiles_sanitaires', 'svm_portfolios_learning': '4825680,4829009,4825557,4824709,4824714,4824733,4825676,4824737,4824753,4829002,4824848,4824863,4825667,4825677', 'photo_hashtag_type': 4151, 'photo_desc_type': 5557, 'type_classification': 'caffe', 'hashtag_id_list': '2107760128,492774966,492741797,493012381,492636447,2107756122,493202403,492628673,492668766,628944319,2107755846,2107755900,2107759152,2107760129'}] thcl {'id': 3233, 'mtr_user_id': 31, 'name': 'learn_generique_01122021_6000_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'barquette_opaque,carton,ela,environnement,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_fonce,pet_opaque,textiles_sanitaires', 'svm_portfolios_learning': '4825680,4829009,4825557,4824709,4824714,4824733,4825676,4824737,4824753,4829002,4824848,4824863,4825667,4825677', 'photo_hashtag_type': 4151, 'photo_desc_type': 5557, 'type_classification': 'caffe', 'hashtag_id_list': '2107760128,492774966,492741797,493012381,492636447,2107756122,493202403,492628673,492668766,628944319,2107755846,2107755900,2107759152,2107760129'} Update svm_hashtag_type_desc : 5557 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5557, 'learn_generique_01122021_6000_v2', 2048, 2048, 'learn_generique_01122021_6000_v2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 1, 19, 59, 17), datetime.datetime(2021, 12, 1, 19, 59, 17)) To loadFromThcl() : net_5557 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10553 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5557, 'learn_generique_01122021_6000_v2', 2048, 2048, 'learn_generique_01122021_6000_v2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 1, 19, 59, 17), datetime.datetime(2021, 12, 1, 19, 59, 17)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_generique_01122021_6000_v2 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_generique_01122021_6000_v2 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_generique_01122021_6000_v2 /data/models_weight/learn_generique_01122021_6000_v2/caffemodel size_local : 94383085 size in s3 : 94383085 create time local : 2021-12-09 17:03:46 create time in s3 : 2021-12-01 18:45:54 caffemodel already exist and didn't need to update /data/models_weight/learn_generique_01122021_6000_v2/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-09 17:03:46 create time in s3 : 2021-12-01 18:45:53 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_generique_01122021_6000_v2/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-09 17:03:47 create time in s3 : 2021-12-01 18:59:02 mean.npy already exist and didn't need to update /data/models_weight/learn_generique_01122021_6000_v2/synset_words.txt size_local : 454 size in s3 : 454 create time local : 2021-12-09 17:03:47 create time in s3 : 2021-12-01 18:59:15 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_generique_01122021_6000_v2/deploy.prototxt caffemodel_filename : /data/models_weight/learn_generique_01122021_6000_v2/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10334 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.1997919082641602 time used to do the prediction : 0.9111278057098389 save descriptor for thcl : 3233 time to traite the descriptors : 1.376373052597046 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1333547226 To insert : 1333547227 To insert : 1333547228 To insert : 1333547229 To insert : 1333547230 To insert : 1333547231 To insert : 1333547232 To insert : 1333547233 To insert : 1333547234 To insert : 1333547235 To insert : 1333547236 To insert : 1333547237 To insert : 1333547238 To insert : 1333547239 To insert : 1333547240 To insert : 1333547241 To insert : 1333547242 To insert : 1333547243 To insert : 1333547244 To insert : 1333547245 To insert : 1333547246 To insert : 1333547247 To insert : 1333547248 To insert : 1333547249 To insert : 1333547375 To insert : 1333547376 To insert : 1333547377 To insert : 1333547378 To insert : 1333547379 To insert : 1333547381 To insert : 1333547382 To insert : 1333547383 To insert : 1333547384 To insert : 1333547385 To insert : 1333547386 To insert : 1333547387 To insert : 1333547388 To insert : 1333547389 To insert : 1333547390 To insert : 1333547392 To insert : 1333547393 To insert : 1333547251 To insert : 1333547252 To insert : 1333547253 To insert : 1333547254 To insert : 1333547255 To insert : 1333547256 To insert : 1333547257 To insert : 1333547258 To insert : 1333547260 To insert : 1333547261 To insert : 1333547262 To insert : 1333547263 To insert : 1333547264 To insert : 1333547265 To insert : 1333547267 To insert : 1333547268 To insert : 1333547269 To insert : 1333547270 To insert : 1333547271 To insert : 1333547273 To insert : 1333547274 To insert : 1333547275 To insert : 1333547276 To insert : 1333547277 To insert : 1333547174 To insert : 1333547175 To insert : 1333547176 To insert : 1333547177 To insert : 1333547178 To insert : 1333547179 To insert : 1333547180 To insert : 1333547181 To insert : 1333547182 To insert : 1333547183 To insert : 1333547184 To insert : 1333547185 To insert : 1333547186 To insert : 1333547187 To insert : 1333547188 To insert : 1333547190 To insert : 1333547191 To insert : 1333547192 To insert : 1333547193 To insert : 1333547194 To insert : 1333547195 To insert : 1333547197 To insert : 1333547198 To insert : 1333547199 To insert : 1333547092 To insert : 1333547096 To insert : 1333547098 To insert : 1333547099 To insert : 1333547100 To insert : 1333547101 To insert : 1333547102 To insert : 1333547103 To insert : 1333547104 To insert : 1333547105 To insert : 1333547106 To insert : 1333547111 To insert : 1333547112 To insert : 1333547113 To insert : 1333547114 To insert : 1333547115 To insert : 1333547116 To insert : 1333547117 To insert : 1333547118 To insert : 1333547119 To insert : 1333547120 To insert : 1333547121 To insert : 1333547122 To insert : 1333547123 To insert : 1333547350 To insert : 1333547351 To insert : 1333547352 To insert : 1333547353 To insert : 1333547354 To insert : 1333547355 To insert : 1333547356 To insert : 1333547357 To insert : 1333547358 To insert : 1333547359 To insert : 1333547360 To insert : 1333547361 To insert : 1333547363 To insert : 1333547364 To insert : 1333547365 To insert : 1333547366 To insert : 1333547367 To insert : 1333547368 To insert : 1333547369 To insert : 1333547370 To insert : 1333547371 To insert : 1333547372 To insert : 1333547373 To insert : 1333547374 To insert : 1333547278 To insert : 1333547279 To insert : 1333547280 To insert : 1333547286 To insert : 1333547287 To insert : 1333547288 To insert : 1333547289 To insert : 1333547290 To insert : 1333547291 To insert : 1333547292 To insert : 1333547293 To insert : 1333547295 To insert : 1333547296 To insert : 1333547297 To insert : 1333547298 To insert : 1333547299 To insert : 1333547300 To insert : 1333547301 To insert : 1333547302 To insert : 1333547303 To insert : 1333547346 To insert : 1333547347 To insert : 1333547348 To insert : 1333547349 To insert : 1333547200 To insert : 1333547201 To insert : 1333547202 To insert : 1333547203 To insert : 1333547204 To insert : 1333547205 To insert : 1333547207 To insert : 1333547208 To insert : 1333547209 To insert : 1333547210 To insert : 1333547212 To insert : 1333547213 To insert : 1333547214 To insert : 1333547215 To insert : 1333547216 To insert : 1333547217 To insert : 1333547218 To insert : 1333547219 To insert : 1333547220 To insert : 1333547221 To insert : 1333547222 To insert : 1333547223 To insert : 1333547224 To insert : 1333547225 To insert : 1333547124 To insert : 1333547125 To insert : 1333547126 To insert : 1333547127 To insert : 1333547128 To insert : 1333547129 To insert : 1333547130 To insert : 1333547131 To insert : 1333547132 To insert : 1333547133 To insert : 1333547134 To insert : 1333547135 To insert : 1333547148 To insert : 1333547149 To insert : 1333547150 To insert : 1333547151 To insert : 1333547152 To insert : 1333547153 To insert : 1333547154 To insert : 1333547155 To insert : 1333547170 To insert : 1333547171 To insert : 1333547172 To insert : 1333547173 To insert : 1333547040 To insert : 1333547041 To insert : 1333547042 To insert : 1333547043 To insert : 1333547044 To insert : 1333547045 To insert : 1333547046 To insert : 1333547047 To insert : 1333547048 To insert : 1333547049 To insert : 1333547052 To insert : 1333547055 To insert : 1333547058 To insert : 1333547062 To insert : 1333547065 To insert : 1333547068 To insert : 1333547071 To insert : 1333547074 To insert : 1333547078 To insert : 1333547081 To insert : 1333547084 To insert : 1333547085 To insert : 1333547086 To insert : 1333547089 time to insert the descriptors : 41.405773878097534 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 329 time used for this insertion : 0.025961875915527344 save missing photos in datou_result : time spend for datou_step_exec : 49.04145646095276 time spend to save output : 0.09404301643371582 total time spend for step 5 : 49.135499477386475 step6:argmax Sat Feb 1 02:07:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou_step Argmax ! calculate argmax for thcl : 3233 Inside saveOutput : final : False verbose : 0 photo_id : 1333547226 output[photo_id] : [('1333547226', 'carton', 0.89201707, 4151, '3233'), 'temp/1738371867_2640705_1330317036_923bcf5fea3769f3699e8f932149de7e_rle_crop_3627093821_0.png'] photo_id : 1333547227 output[photo_id] : [('1333547227', 'papier', 0.54441845, 4151, '3233'), 'temp/1738371867_2640705_1330317036_923bcf5fea3769f3699e8f932149de7e_rle_crop_3627093828_0.png'] photo_id : 1333547228 output[photo_id] : [('1333547228', 'ela', 0.50460684, 4151, '3233'), 'temp/1738371867_2640705_1330317036_923bcf5fea3769f3699e8f932149de7e_rle_crop_3627093827_0.png'] photo_id : 1333547229 output[photo_id] : [('1333547229', 'pet_fonce', 0.6349784, 4151, '3233'), 'temp/1738371867_2640705_1330317036_923bcf5fea3769f3699e8f932149de7e_rle_crop_3627093824_0.png'] photo_id : 1333547230 output[photo_id] : [('1333547230', 'barquette_opaque', 0.90215075, 4151, '3233'), 'temp/1738371867_2640705_1330317036_923bcf5fea3769f3699e8f932149de7e_rle_crop_3627093820_0.png'] photo_id : 1333547231 output[photo_id] : [('1333547231', 'papier', 0.6552178, 4151, '3233'), 'temp/1738371867_2640705_1330317036_923bcf5fea3769f3699e8f932149de7e_rle_crop_3648044633_0.png'] photo_id : 1333547232 output[photo_id] : [('1333547232', 'papier', 0.3633137, 4151, '3233'), 'temp/1738371867_2640705_1330317036_923bcf5fea3769f3699e8f932149de7e_rle_crop_3627093813_0.png'] photo_id : 1333547233 output[photo_id] : [('1333547233', 'etiquette', 0.74693614, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3627093843_0.png'] photo_id : 1333547234 output[photo_id] : [('1333547234', 'etiquette', 0.67296237, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3627093838_0.png'] photo_id : 1333547235 output[photo_id] : [('1333547235', 'etiquette', 0.78857946, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3627093852_0.png'] photo_id : 1333547236 output[photo_id] : [('1333547236', 'papier', 0.65127236, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3627093839_0.png'] photo_id : 1333547237 output[photo_id] : [('1333547237', 'environnement', 0.5078048, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3627093842_0.png'] photo_id : 1333547238 output[photo_id] : [('1333547238', 'papier', 0.9453874, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3627093855_0.png'] photo_id : 1333547239 output[photo_id] : [('1333547239', 'papier', 0.6001516, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3627093857_0.png'] photo_id : 1333547240 output[photo_id] : [('1333547240', 'etiquette', 0.7240769, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3627093836_0.png'] photo_id : 1333547241 output[photo_id] : [('1333547241', 'barquette_opaque', 0.9817394, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3627093854_0.png'] photo_id : 1333547242 output[photo_id] : [('1333547242', 'environnement', 0.41546738, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3627093856_0.png'] photo_id : 1333547243 output[photo_id] : [('1333547243', 'papier', 0.76651686, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3648044634_0.png'] photo_id : 1333547244 output[photo_id] : [('1333547244', 'metal', 0.55327386, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3627093858_0.png'] photo_id : 1333547245 output[photo_id] : [('1333547245', 'barquette_opaque', 0.54920805, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093884_0.png'] photo_id : 1333547246 output[photo_id] : [('1333547246', 'papier', 0.46348405, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093893_0.png'] photo_id : 1333547247 output[photo_id] : [('1333547247', 'papier', 0.32788602, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093879_0.png'] photo_id : 1333547248 output[photo_id] : [('1333547248', 'papier', 0.79951227, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093896_0.png'] photo_id : 1333547249 output[photo_id] : [('1333547249', 'barquette_opaque', 0.7651513, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093883_0.png'] photo_id : 1333547375 output[photo_id] : [('1333547375', 'barquette_opaque', 0.97042733, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3648044639_0.png'] photo_id : 1333547376 output[photo_id] : [('1333547376', 'etiquette', 0.6443967, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093888_0.png'] photo_id : 1333547377 output[photo_id] : [('1333547377', 'barquette_opaque', 0.99738425, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093865_0.png'] photo_id : 1333547378 output[photo_id] : [('1333547378', 'barquette_opaque', 0.92376524, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093871_0.png'] photo_id : 1333547379 output[photo_id] : [('1333547379', 'pet_opaque', 0.6797655, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093881_0.png'] photo_id : 1333547381 output[photo_id] : [('1333547381', 'papier', 0.9154572, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093870_0.png'] photo_id : 1333547382 output[photo_id] : [('1333547382', 'papier', 0.96194625, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093886_0.png'] photo_id : 1333547383 output[photo_id] : [('1333547383', 'barquette_opaque', 0.9984964, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093905_0.png'] photo_id : 1333547384 output[photo_id] : [('1333547384', 'metal', 0.44282717, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093919_0.png'] photo_id : 1333547385 output[photo_id] : [('1333547385', 'papier', 0.4932526, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093925_0.png'] photo_id : 1333547386 output[photo_id] : [('1333547386', 'barquette_opaque', 0.8948384, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093920_0.png'] photo_id : 1333547387 output[photo_id] : [('1333547387', 'barquette_opaque', 0.7060705, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093928_0.png'] photo_id : 1333547388 output[photo_id] : [('1333547388', 'pet_fonce', 0.8019477, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093912_0.png'] photo_id : 1333547389 output[photo_id] : [('1333547389', 'barquette_opaque', 0.30645895, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093916_0.png'] photo_id : 1333547390 output[photo_id] : [('1333547390', 'barquette_opaque', 0.7854259, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093935_0.png'] photo_id : 1333547392 output[photo_id] : [('1333547392', 'barquette_opaque', 0.99260145, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093917_0.png'] photo_id : 1333547393 output[photo_id] : [('1333547393', 'etiquette', 0.52952504, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093933_0.png'] photo_id : 1333547251 output[photo_id] : [('1333547251', 'environnement', 0.38111305, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3648044638_0.png'] photo_id : 1333547252 output[photo_id] : [('1333547252', 'etiquette', 0.37907246, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3648044641_0.png'] photo_id : 1333547253 output[photo_id] : [('1333547253', 'metal', 0.95558536, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093897_0.png'] photo_id : 1333547254 output[photo_id] : [('1333547254', 'metal', 0.4763701, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093889_0.png'] photo_id : 1333547255 output[photo_id] : [('1333547255', 'film_plastique', 0.3386431, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3648044643_0.png'] photo_id : 1333547256 output[photo_id] : [('1333547256', 'pet_opaque', 0.44980347, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093885_0.png'] photo_id : 1333547257 output[photo_id] : [('1333547257', 'barquette_opaque', 0.94959337, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093898_0.png'] photo_id : 1333547258 output[photo_id] : [('1333547258', 'carton', 0.3359545, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093891_0.png'] photo_id : 1333547260 output[photo_id] : [('1333547260', 'pet_fonce', 0.31466067, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093915_0.png'] photo_id : 1333547261 output[photo_id] : [('1333547261', 'papier', 0.4576059, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093936_0.png'] photo_id : 1333547262 output[photo_id] : [('1333547262', 'barquette_opaque', 0.90867954, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3648044644_0.png'] photo_id : 1333547263 output[photo_id] : [('1333547263', 'barquette_opaque', 0.5464705, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093926_0.png'] photo_id : 1333547264 output[photo_id] : [('1333547264', 'pet_fonce', 0.74737066, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093922_0.png'] photo_id : 1333547265 output[photo_id] : [('1333547265', 'barquette_opaque', 0.8964502, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093921_0.png'] photo_id : 1333547267 output[photo_id] : [('1333547267', 'environnement', 0.38399172, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093930_0.png'] photo_id : 1333547268 output[photo_id] : [('1333547268', 'papier', 0.29691488, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093927_0.png'] photo_id : 1333547269 output[photo_id] : [('1333547269', 'metal', 0.3991179, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093923_0.png'] photo_id : 1333547270 output[photo_id] : [('1333547270', 'etiquette', 0.85008854, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093924_0.png'] photo_id : 1333547271 output[photo_id] : [('1333547271', 'pet_opaque', 0.72336715, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093914_0.png'] photo_id : 1333547273 output[photo_id] : [('1333547273', 'carton', 0.3367523, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093938_0.png'] photo_id : 1333547274 output[photo_id] : [('1333547274', 'metal', 0.5360945, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093931_0.png'] photo_id : 1333547275 output[photo_id] : [('1333547275', 'etiquette', 0.5347688, 4151, '3233'), 'temp/1738371867_2640705_1330317076_102a5c7bdf495f4ff5349193df334f8a_rle_crop_3627093729_0.png'] photo_id : 1333547276 output[photo_id] : [('1333547276', 'etiquette', 0.94831043, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093757_0.png'] photo_id : 1333547277 output[photo_id] : [('1333547277', 'etiquette', 0.92123497, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093774_0.png'] photo_id : 1333547174 output[photo_id] : [('1333547174', 'metal', 0.47589198, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093639_0.png'] photo_id : 1333547175 output[photo_id] : [('1333547175', 'carton', 0.6623408, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093637_0.png'] photo_id : 1333547176 output[photo_id] : [('1333547176', 'pet_opaque', 0.8582422, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093626_0.png'] photo_id : 1333547177 output[photo_id] : [('1333547177', 'etiquette', 0.694, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3648044622_0.png'] photo_id : 1333547178 output[photo_id] : [('1333547178', 'metal', 0.32772171, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093623_0.png'] photo_id : 1333547179 output[photo_id] : [('1333547179', 'etiquette', 0.81212324, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093672_0.png'] photo_id : 1333547180 output[photo_id] : [('1333547180', 'etiquette', 0.87197345, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093657_0.png'] photo_id : 1333547181 output[photo_id] : [('1333547181', 'papier', 0.57550466, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093666_0.png'] photo_id : 1333547182 output[photo_id] : [('1333547182', 'etiquette', 0.47633728, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093649_0.png'] photo_id : 1333547183 output[photo_id] : [('1333547183', 'barquette_opaque', 0.98468137, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093664_0.png'] photo_id : 1333547184 output[photo_id] : [('1333547184', 'etiquette', 0.9269068, 4151, '3233'), 'temp/1738371867_2640705_1330317079_23424db30e8c84877ee055facd0b35b2_rle_crop_3627093689_0.png'] photo_id : 1333547185 output[photo_id] : [('1333547185', 'metal', 0.82608694, 4151, '3233'), 'temp/1738371867_2640705_1330317079_23424db30e8c84877ee055facd0b35b2_rle_crop_3627093695_0.png'] photo_id : 1333547186 output[photo_id] : [('1333547186', 'barquette_opaque', 0.291995, 4151, '3233'), 'temp/1738371867_2640705_1330317079_23424db30e8c84877ee055facd0b35b2_rle_crop_3627093694_0.png'] photo_id : 1333547187 output[photo_id] : [('1333547187', 'metal', 0.32692844, 4151, '3233'), 'temp/1738371867_2640705_1330317079_23424db30e8c84877ee055facd0b35b2_rle_crop_3627093697_0.png'] photo_id : 1333547188 output[photo_id] : [('1333547188', 'papier', 0.5891082, 4151, '3233'), 'temp/1738371867_2640705_1330317079_23424db30e8c84877ee055facd0b35b2_rle_crop_3627093688_0.png'] photo_id : 1333547190 output[photo_id] : [('1333547190', 'papier', 0.7183415, 4151, '3233'), 'temp/1738371867_2640705_1330317079_23424db30e8c84877ee055facd0b35b2_rle_crop_3627093701_0.png'] photo_id : 1333547191 output[photo_id] : [('1333547191', 'papier', 0.24533752, 4151, '3233'), 'temp/1738371867_2640705_1330317079_23424db30e8c84877ee055facd0b35b2_rle_crop_3627093693_0.png'] photo_id : 1333547192 output[photo_id] : [('1333547192', 'etiquette', 0.9304911, 4151, '3233'), 'temp/1738371867_2640705_1330317079_23424db30e8c84877ee055facd0b35b2_rle_crop_3627093690_0.png'] photo_id : 1333547193 output[photo_id] : [('1333547193', 'papier', 0.6091637, 4151, '3233'), 'temp/1738371867_2640705_1330317079_23424db30e8c84877ee055facd0b35b2_rle_crop_3627093681_0.png'] photo_id : 1333547194 output[photo_id] : [('1333547194', 'etiquette', 0.50965136, 4151, '3233'), 'temp/1738371867_2640705_1330317076_102a5c7bdf495f4ff5349193df334f8a_rle_crop_3627093715_0.png'] photo_id : 1333547195 output[photo_id] : [('1333547195', 'pet_fonce', 0.48597652, 4151, '3233'), 'temp/1738371867_2640705_1330317076_102a5c7bdf495f4ff5349193df334f8a_rle_crop_3627093728_0.png'] photo_id : 1333547197 output[photo_id] : [('1333547197', 'etiquette', 0.32967448, 4151, '3233'), 'temp/1738371867_2640705_1330317076_102a5c7bdf495f4ff5349193df334f8a_rle_crop_3648044630_0.png'] photo_id : 1333547198 output[photo_id] : [('1333547198', 'carton', 0.34395453, 4151, '3233'), 'temp/1738371867_2640705_1330317076_102a5c7bdf495f4ff5349193df334f8a_rle_crop_3627093718_0.png'] photo_id : 1333547199 output[photo_id] : [('1333547199', 'pet_opaque', 0.28783816, 4151, '3233'), 'temp/1738371867_2640705_1330317076_102a5c7bdf495f4ff5349193df334f8a_rle_crop_3627093725_0.png'] photo_id : 1333547092 output[photo_id] : [('1333547092', 'barquette_opaque', 0.9398828, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3627093840_0.png'] photo_id : 1333547096 output[photo_id] : [('1333547096', 'barquette_opaque', 0.8720984, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3627093853_0.png'] photo_id : 1333547098 output[photo_id] : [('1333547098', 'etiquette', 0.8769523, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3627093851_0.png'] photo_id : 1333547099 output[photo_id] : [('1333547099', 'etiquette', 0.5215162, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3627093847_0.png'] photo_id : 1333547100 output[photo_id] : [('1333547100', 'metal', 0.35334435, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093892_0.png'] photo_id : 1333547101 output[photo_id] : [('1333547101', 'papier', 0.25121802, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093904_0.png'] photo_id : 1333547102 output[photo_id] : [('1333547102', 'pet_fonce', 0.5810636, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093869_0.png'] photo_id : 1333547103 output[photo_id] : [('1333547103', 'barquette_opaque', 0.8683219, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093872_0.png'] photo_id : 1333547104 output[photo_id] : [('1333547104', 'papier', 0.43140033, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093895_0.png'] photo_id : 1333547105 output[photo_id] : [('1333547105', 'papier', 0.30339578, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093934_0.png'] photo_id : 1333547106 output[photo_id] : [('1333547106', 'film_plastique', 0.5049568, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093929_0.png'] photo_id : 1333547111 output[photo_id] : [('1333547111', 'film_plastique', 0.57868016, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093628_0.png'] photo_id : 1333547112 output[photo_id] : [('1333547112', 'papier', 0.45701295, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093640_0.png'] photo_id : 1333547113 output[photo_id] : [('1333547113', 'metal', 0.7542, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093631_0.png'] photo_id : 1333547114 output[photo_id] : [('1333547114', 'etiquette', 0.90174466, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093635_0.png'] photo_id : 1333547115 output[photo_id] : [('1333547115', 'etiquette', 0.5367866, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093650_0.png'] photo_id : 1333547116 output[photo_id] : [('1333547116', 'etiquette', 0.5560135, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3648044624_0.png'] photo_id : 1333547117 output[photo_id] : [('1333547117', 'papier', 0.6206273, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3648044625_0.png'] photo_id : 1333547118 output[photo_id] : [('1333547118', 'papier', 0.59658355, 4151, '3233'), 'temp/1738371867_2640705_1330317079_23424db30e8c84877ee055facd0b35b2_rle_crop_3627093698_0.png'] photo_id : 1333547119 output[photo_id] : [('1333547119', 'papier', 0.7236361, 4151, '3233'), 'temp/1738371867_2640705_1330317079_23424db30e8c84877ee055facd0b35b2_rle_crop_3627093685_0.png'] photo_id : 1333547120 output[photo_id] : [('1333547120', 'etiquette', 0.9451564, 4151, '3233'), 'temp/1738371867_2640705_1330317076_102a5c7bdf495f4ff5349193df334f8a_rle_crop_3627093730_0.png'] photo_id : 1333547121 output[photo_id] : [('1333547121', 'barquette_opaque', 0.3467265, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093744_0.png'] photo_id : 1333547122 output[photo_id] : [('1333547122', 'barquette_opaque', 0.5278203, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093753_0.png'] photo_id : 1333547123 output[photo_id] : [('1333547123', 'etiquette', 0.9654169, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093758_0.png'] photo_id : 1333547350 output[photo_id] : [('1333547350', 'barquette_opaque', 0.9867198, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093676_0.png'] photo_id : 1333547351 output[photo_id] : [('1333547351', 'carton', 0.38910022, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093665_0.png'] photo_id : 1333547352 output[photo_id] : [('1333547352', 'pet_opaque', 0.5519413, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093653_0.png'] photo_id : 1333547353 output[photo_id] : [('1333547353', 'barquette_opaque', 0.8518778, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093670_0.png'] photo_id : 1333547354 output[photo_id] : [('1333547354', 'barquette_opaque', 0.97355723, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093644_0.png'] photo_id : 1333547355 output[photo_id] : [('1333547355', 'barquette_opaque', 0.5439661, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093660_0.png'] photo_id : 1333547356 output[photo_id] : [('1333547356', 'barquette_opaque', 0.9788811, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093668_0.png'] photo_id : 1333547357 output[photo_id] : [('1333547357', 'barquette_opaque', 0.7065449, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093651_0.png'] photo_id : 1333547358 output[photo_id] : [('1333547358', 'pet_opaque', 0.51103354, 4151, '3233'), 'temp/1738371867_2640705_1330317079_23424db30e8c84877ee055facd0b35b2_rle_crop_3627093692_0.png'] photo_id : 1333547359 output[photo_id] : [('1333547359', 'barquette_opaque', 0.9247413, 4151, '3233'), 'temp/1738371867_2640705_1330317076_102a5c7bdf495f4ff5349193df334f8a_rle_crop_3627093714_0.png'] photo_id : 1333547360 output[photo_id] : [('1333547360', 'papier', 0.7763091, 4151, '3233'), 'temp/1738371867_2640705_1330317076_102a5c7bdf495f4ff5349193df334f8a_rle_crop_3627093713_0.png'] photo_id : 1333547361 output[photo_id] : [('1333547361', 'barquette_opaque', 0.99815375, 4151, '3233'), 'temp/1738371867_2640705_1330317076_102a5c7bdf495f4ff5349193df334f8a_rle_crop_3627093711_0.png'] photo_id : 1333547363 output[photo_id] : [('1333547363', 'barquette_opaque', 0.60688365, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093741_0.png'] photo_id : 1333547364 output[photo_id] : [('1333547364', 'barquette_opaque', 0.6312565, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093759_0.png'] photo_id : 1333547365 output[photo_id] : [('1333547365', 'etiquette', 0.5503307, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093746_0.png'] photo_id : 1333547366 output[photo_id] : [('1333547366', 'barquette_opaque', 0.91496015, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093739_0.png'] photo_id : 1333547367 output[photo_id] : [('1333547367', 'barquette_opaque', 0.86058235, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093770_0.png'] photo_id : 1333547368 output[photo_id] : [('1333547368', 'papier', 0.41724756, 4151, '3233'), 'temp/1738371867_2640705_1330317036_923bcf5fea3769f3699e8f932149de7e_rle_crop_3627093825_0.png'] photo_id : 1333547369 output[photo_id] : [('1333547369', 'barquette_opaque', 0.9998605, 4151, '3233'), 'temp/1738371867_2640705_1330317036_923bcf5fea3769f3699e8f932149de7e_rle_crop_3648044632_0.png'] photo_id : 1333547370 output[photo_id] : [('1333547370', 'barquette_opaque', 0.6793238, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3627093860_0.png'] photo_id : 1333547371 output[photo_id] : [('1333547371', 'barquette_opaque', 0.9999846, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3627093861_0.png'] photo_id : 1333547372 output[photo_id] : [('1333547372', 'pet_opaque', 0.98857695, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3627093837_0.png'] photo_id : 1333547373 output[photo_id] : [('1333547373', 'papier', 0.4726843, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3648044642_0.png'] photo_id : 1333547374 output[photo_id] : [('1333547374', 'barquette_opaque', 0.7174104, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093877_0.png'] photo_id : 1333547278 output[photo_id] : [('1333547278', 'etiquette', 0.840958, 4151, '3233'), 'temp/1738371867_2640705_1330317036_923bcf5fea3769f3699e8f932149de7e_rle_crop_3627093823_0.png'] photo_id : 1333547279 output[photo_id] : [('1333547279', 'etiquette', 0.9597472, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3627093848_0.png'] photo_id : 1333547280 output[photo_id] : [('1333547280', 'etiquette', 0.8768915, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093906_0.png'] photo_id : 1333547286 output[photo_id] : [('1333547286', 'barquette_opaque', 0.81682926, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093659_0.png'] photo_id : 1333547287 output[photo_id] : [('1333547287', 'barquette_opaque', 0.7684023, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093673_0.png'] photo_id : 1333547288 output[photo_id] : [('1333547288', 'papier', 0.8270179, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093674_0.png'] photo_id : 1333547289 output[photo_id] : [('1333547289', 'film_plastique', 0.4155608, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093662_0.png'] photo_id : 1333547290 output[photo_id] : [('1333547290', 'barquette_opaque', 0.50366706, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093658_0.png'] photo_id : 1333547291 output[photo_id] : [('1333547291', 'metal', 0.7380892, 4151, '3233'), 'temp/1738371867_2640705_1330317076_102a5c7bdf495f4ff5349193df334f8a_rle_crop_3627093724_0.png'] photo_id : 1333547292 output[photo_id] : [('1333547292', 'barquette_opaque', 0.901127, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093789_0.png'] photo_id : 1333547293 output[photo_id] : [('1333547293', 'environnement', 0.34439996, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093785_0.png'] photo_id : 1333547295 output[photo_id] : [('1333547295', 'etiquette', 0.38525522, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093799_0.png'] photo_id : 1333547296 output[photo_id] : [('1333547296', 'pet_clair', 0.61130077, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093796_0.png'] photo_id : 1333547297 output[photo_id] : [('1333547297', 'etiquette', 0.58076364, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093802_0.png'] photo_id : 1333547298 output[photo_id] : [('1333547298', 'metal', 0.8594589, 4151, '3233'), 'temp/1738371867_2640705_1330317036_923bcf5fea3769f3699e8f932149de7e_rle_crop_3627093812_0.png'] photo_id : 1333547299 output[photo_id] : [('1333547299', 'barquette_opaque', 0.9846732, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093899_0.png'] photo_id : 1333547300 output[photo_id] : [('1333547300', 'papier', 0.76817894, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093894_0.png'] photo_id : 1333547301 output[photo_id] : [('1333547301', 'etiquette', 0.5860212, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093937_0.png'] photo_id : 1333547302 output[photo_id] : [('1333547302', 'film_plastique', 0.7489255, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093932_0.png'] photo_id : 1333547303 output[photo_id] : [('1333547303', 'carton', 0.48208773, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093918_0.png'] photo_id : 1333547346 output[photo_id] : [('1333547346', 'barquette_opaque', 0.9843262, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093613_0.png'] photo_id : 1333547347 output[photo_id] : [('1333547347', 'etiquette', 0.32115322, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093614_0.png'] photo_id : 1333547348 output[photo_id] : [('1333547348', 'barquette_opaque', 0.991052, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093620_0.png'] photo_id : 1333547349 output[photo_id] : [('1333547349', 'barquette_opaque', 0.9521589, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093621_0.png'] photo_id : 1333547200 output[photo_id] : [('1333547200', 'etiquette', 0.52304715, 4151, '3233'), 'temp/1738371867_2640705_1330317076_102a5c7bdf495f4ff5349193df334f8a_rle_crop_3627093721_0.png'] photo_id : 1333547201 output[photo_id] : [('1333547201', 'etiquette', 0.8688976, 4151, '3233'), 'temp/1738371867_2640705_1330317076_102a5c7bdf495f4ff5349193df334f8a_rle_crop_3627093723_0.png'] photo_id : 1333547202 output[photo_id] : [('1333547202', 'metal', 0.4015526, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093754_0.png'] photo_id : 1333547203 output[photo_id] : [('1333547203', 'barquette_opaque', 0.2511027, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093745_0.png'] photo_id : 1333547204 output[photo_id] : [('1333547204', 'barquette_opaque', 0.4164137, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093737_0.png'] photo_id : 1333547205 output[photo_id] : [('1333547205', 'pet_fonce', 0.3476481, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093748_0.png'] photo_id : 1333547207 output[photo_id] : [('1333547207', 'etiquette', 0.43988606, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093762_0.png'] photo_id : 1333547208 output[photo_id] : [('1333547208', 'carton', 0.3639734, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093747_0.png'] photo_id : 1333547209 output[photo_id] : [('1333547209', 'etiquette', 0.41509932, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093752_0.png'] photo_id : 1333547210 output[photo_id] : [('1333547210', 'etiquette', 0.9303783, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093751_0.png'] photo_id : 1333547212 output[photo_id] : [('1333547212', 'etiquette', 0.6005231, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093780_0.png'] photo_id : 1333547213 output[photo_id] : [('1333547213', 'etiquette', 0.38812572, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093784_0.png'] photo_id : 1333547214 output[photo_id] : [('1333547214', 'barquette_opaque', 0.98766756, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093797_0.png'] photo_id : 1333547215 output[photo_id] : [('1333547215', 'metal', 0.558845, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093795_0.png'] photo_id : 1333547216 output[photo_id] : [('1333547216', 'metal', 0.28402445, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093773_0.png'] photo_id : 1333547217 output[photo_id] : [('1333547217', 'pet_opaque', 0.81205565, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093782_0.png'] photo_id : 1333547218 output[photo_id] : [('1333547218', 'carton', 0.7075619, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093786_0.png'] photo_id : 1333547219 output[photo_id] : [('1333547219', 'etiquette', 0.6218246, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093793_0.png'] photo_id : 1333547220 output[photo_id] : [('1333547220', 'etiquette', 0.46737972, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093779_0.png'] photo_id : 1333547221 output[photo_id] : [('1333547221', 'etiquette', 0.8709013, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093781_0.png'] photo_id : 1333547222 output[photo_id] : [('1333547222', 'barquette_opaque', 0.6031748, 4151, '3233'), 'temp/1738371867_2640705_1330317036_923bcf5fea3769f3699e8f932149de7e_rle_crop_3627093818_0.png'] photo_id : 1333547223 output[photo_id] : [('1333547223', 'papier', 0.57931507, 4151, '3233'), 'temp/1738371867_2640705_1330317036_923bcf5fea3769f3699e8f932149de7e_rle_crop_3627093819_0.png'] photo_id : 1333547224 output[photo_id] : [('1333547224', 'papier', 0.93789965, 4151, '3233'), 'temp/1738371867_2640705_1330317036_923bcf5fea3769f3699e8f932149de7e_rle_crop_3627093826_0.png'] photo_id : 1333547225 output[photo_id] : [('1333547225', 'etiquette', 0.93018794, 4151, '3233'), 'temp/1738371867_2640705_1330317036_923bcf5fea3769f3699e8f932149de7e_rle_crop_3627093816_0.png'] photo_id : 1333547124 output[photo_id] : [('1333547124', 'papier', 0.45094302, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093749_0.png'] photo_id : 1333547125 output[photo_id] : [('1333547125', 'etiquette', 0.4654198, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093763_0.png'] photo_id : 1333547126 output[photo_id] : [('1333547126', 'etiquette', 0.7509315, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093761_0.png'] photo_id : 1333547127 output[photo_id] : [('1333547127', 'papier', 0.9195734, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093791_0.png'] photo_id : 1333547128 output[photo_id] : [('1333547128', 'etiquette', 0.3746862, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093777_0.png'] photo_id : 1333547129 output[photo_id] : [('1333547129', 'etiquette', 0.5965146, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093794_0.png'] photo_id : 1333547130 output[photo_id] : [('1333547130', 'barquette_opaque', 0.78854597, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093792_0.png'] photo_id : 1333547131 output[photo_id] : [('1333547131', 'papier', 0.47913656, 4151, '3233'), 'temp/1738371867_2640705_1330317036_923bcf5fea3769f3699e8f932149de7e_rle_crop_3627093806_0.png'] photo_id : 1333547132 output[photo_id] : [('1333547132', 'barquette_opaque', 0.7661534, 4151, '3233'), 'temp/1738371867_2640705_1330317036_923bcf5fea3769f3699e8f932149de7e_rle_crop_3627093810_0.png'] photo_id : 1333547133 output[photo_id] : [('1333547133', 'etiquette', 0.6882807, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3627093850_0.png'] photo_id : 1333547134 output[photo_id] : [('1333547134', 'papier', 0.36644003, 4151, '3233'), 'temp/1738371867_2640705_1330317028_cda2273454c45608c245cc479759d51b_rle_crop_3648044635_0.png'] photo_id : 1333547135 output[photo_id] : [('1333547135', 'etiquette', 0.4964185, 4151, '3233'), 'temp/1738371867_2640705_1330317011_a2810ec0919f20251d14ba4f32a092d7_rle_crop_3627093941_0.png'] photo_id : 1333547148 output[photo_id] : [('1333547148', 'metal', 0.72940105, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093624_0.png'] photo_id : 1333547149 output[photo_id] : [('1333547149', 'barquette_opaque', 0.56946015, 4151, '3233'), 'temp/1738371867_2640705_1330317079_23424db30e8c84877ee055facd0b35b2_rle_crop_3627093696_0.png'] photo_id : 1333547150 output[photo_id] : [('1333547150', 'film_plastique', 0.63077235, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093760_0.png'] photo_id : 1333547151 output[photo_id] : [('1333547151', 'etiquette', 0.31031957, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093778_0.png'] photo_id : 1333547152 output[photo_id] : [('1333547152', 'film_plastique', 0.8278304, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093801_0.png'] photo_id : 1333547153 output[photo_id] : [('1333547153', 'etiquette', 0.60510576, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093776_0.png'] photo_id : 1333547154 output[photo_id] : [('1333547154', 'papier', 0.6582865, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093900_0.png'] photo_id : 1333547155 output[photo_id] : [('1333547155', 'metal', 0.34310362, 4151, '3233'), 'temp/1738371867_2640705_1330317014_96f54134e95724a4af5e9f949bc1c2d0_rle_crop_3627093868_0.png'] photo_id : 1333547170 output[photo_id] : [('1333547170', 'environnement', 0.5317937, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093636_0.png'] photo_id : 1333547171 output[photo_id] : [('1333547171', 'papier', 0.5423275, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093638_0.png'] photo_id : 1333547172 output[photo_id] : [('1333547172', 'etiquette', 0.9242793, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093633_0.png'] photo_id : 1333547173 output[photo_id] : [('1333547173', 'barquette_opaque', 0.9244385, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093616_0.png'] photo_id : 1333547040 output[photo_id] : [('1333547040', 'metal', 0.3044, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093634_0.png'] photo_id : 1333547041 output[photo_id] : [('1333547041', 'barquette_opaque', 0.6103858, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093630_0.png'] photo_id : 1333547042 output[photo_id] : [('1333547042', 'barquette_opaque', 0.6820004, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093632_0.png'] photo_id : 1333547043 output[photo_id] : [('1333547043', 'film_plastique', 0.40286577, 4151, '3233'), 'temp/1738371867_2640705_1330317086_f53f89290ff2eadc61e1ecd449c10d36_rle_crop_3627093618_0.png'] photo_id : 1333547044 output[photo_id] : [('1333547044', 'metal', 0.22772193, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093669_0.png'] photo_id : 1333547045 output[photo_id] : [('1333547045', 'barquette_opaque', 0.8453817, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093652_0.png'] photo_id : 1333547046 output[photo_id] : [('1333547046', 'barquette_opaque', 0.9551078, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093655_0.png'] photo_id : 1333547047 output[photo_id] : [('1333547047', 'etiquette', 0.8272185, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093661_0.png'] photo_id : 1333547048 output[photo_id] : [('1333547048', 'film_plastique', 0.94085443, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3627093667_0.png'] photo_id : 1333547049 output[photo_id] : [('1333547049', 'barquette_opaque', 0.6423027, 4151, '3233'), 'temp/1738371867_2640705_1330317082_04191d3f5db2bd1fdf21466c9a211808_rle_crop_3648044623_0.png'] photo_id : 1333547052 output[photo_id] : [('1333547052', 'pet_clair', 0.538936, 4151, '3233'), 'temp/1738371867_2640705_1330317079_23424db30e8c84877ee055facd0b35b2_rle_crop_3627093700_0.png'] photo_id : 1333547055 output[photo_id] : [('1333547055', 'barquette_opaque', 0.9519607, 4151, '3233'), 'temp/1738371867_2640705_1330317079_23424db30e8c84877ee055facd0b35b2_rle_crop_3627093684_0.png'] photo_id : 1333547058 output[photo_id] : [('1333547058', 'barquette_opaque', 0.39349765, 4151, '3233'), 'temp/1738371867_2640705_1330317076_102a5c7bdf495f4ff5349193df334f8a_rle_crop_3627093710_0.png'] photo_id : 1333547062 output[photo_id] : [('1333547062', 'etiquette', 0.87448794, 4151, '3233'), 'temp/1738371867_2640705_1330317076_102a5c7bdf495f4ff5349193df334f8a_rle_crop_3627093717_0.png'] photo_id : 1333547065 output[photo_id] : [('1333547065', 'film_plastique', 0.85171956, 4151, '3233'), 'temp/1738371867_2640705_1330317076_102a5c7bdf495f4ff5349193df334f8a_rle_crop_3627093722_0.png'] photo_id : 1333547068 output[photo_id] : [('1333547068', 'barquette_opaque', 0.41940573, 4151, '3233'), 'temp/1738371867_2640705_1330317076_102a5c7bdf495f4ff5349193df334f8a_rle_crop_3627093706_0.png'] photo_id : 1333547071 output[photo_id] : [('1333547071', 'papier', 0.33603334, 4151, '3233'), 'temp/1738371867_2640705_1330317076_102a5c7bdf495f4ff5349193df334f8a_rle_crop_3627093716_0.png'] photo_id : 1333547074 output[photo_id] : [('1333547074', 'film_plastique', 0.37800583, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093756_0.png'] photo_id : 1333547078 output[photo_id] : [('1333547078', 'barquette_opaque', 0.9755383, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3627093742_0.png'] photo_id : 1333547081 output[photo_id] : [('1333547081', 'barquette_opaque', 0.88824916, 4151, '3233'), 'temp/1738371867_2640705_1330317073_06708459d71674955fd15bead0e77dfd_rle_crop_3648044631_0.png'] photo_id : 1333547084 output[photo_id] : [('1333547084', 'pet_opaque', 0.5765241, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093787_0.png'] photo_id : 1333547085 output[photo_id] : [('1333547085', 'barquette_opaque', 0.98106235, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093800_0.png'] photo_id : 1333547086 output[photo_id] : [('1333547086', 'barquette_opaque', 0.914943, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093790_0.png'] photo_id : 1333547089 output[photo_id] : [('1333547089', 'barquette_opaque', 0.99121886, 4151, '3233'), 'temp/1738371867_2640705_1330317070_7ea5e8df4d9fcc249c4d711f342666a3_rle_crop_3627093783_0.png'] begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 233 time used for this insertion : 0.0584108829498291 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 233 time used for this insertion : 0.021132946014404297 save missing photos in datou_result : time spend for datou_step_exec : 0.002339601516723633 time spend to save output : 0.08187508583068848 total time spend for step 6 : 0.08421468734741211 step7:merge_mask_thcl_custom Sat Feb 1 02:07:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step merge_mask_thcl_custom this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it batch 1 Loaded 358 chid ids of type : 3760 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++As expected we have just one thcl present begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : batch 1 Loaded 233 chid ids of type : 4210 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 233 chid ids of type : 4210 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++End of step merge_mask_thcl_custom Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : merge_mask_thcl_custom we use saveGeneral [1330317086, 1330317082, 1330317079, 1330317076, 1330317073, 1330317070, 1330317036, 1330317028, 1330317014, 1330317011] Looping around the photos to save general results len do output : 10 /1330317086Didn't retrieve data .Didn't retrieve data . /1330317082Didn't retrieve data .Didn't retrieve data . /1330317079Didn't retrieve data .Didn't retrieve data . /1330317076Didn't retrieve data .Didn't retrieve data . /1330317073Didn't retrieve data .Didn't retrieve data . /1330317070Didn't retrieve data .Didn't retrieve data . /1330317036Didn't retrieve data .Didn't retrieve data . /1330317028Didn't retrieve data .Didn't retrieve data . /1330317014Didn't retrieve data .Didn't retrieve data . /1330317011Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317086', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317082', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317079', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317076', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317073', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317070', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317036', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317028', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317014', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317011', None, None, None, None, None, '2533520') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.012995243072509766 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6910507678985596 time spend to save output : 0.013501167297363281 total time spend for step 7 : 1.7045519351959229 step8:rle_unique_nms_with_priority Sat Feb 1 02:07:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms nb_obj : 22 nb_hashtags : 8 time to prepare the origin masks : 4.3955628871917725 time for calcul the mask position with numpy : 0.21798181533813477 nb_pixel_total : 1807139 time to create 1 rle with new method : 0.09465527534484863 time for calcul the mask position with numpy : 0.011350631713867188 nb_pixel_total : 8066 time to create 1 rle with old method : 0.009418249130249023 time for calcul the mask position with numpy : 0.010389089584350586 nb_pixel_total : 7502 time to create 1 rle with old method : 0.008349895477294922 time for calcul the mask position with numpy : 0.01002359390258789 nb_pixel_total : 1800 time to create 1 rle with old method : 0.0020046234130859375 time for calcul the mask position with numpy : 0.01029348373413086 nb_pixel_total : 13536 time to create 1 rle with old method : 0.015585899353027344 time for calcul the mask position with numpy : 0.00995326042175293 nb_pixel_total : 5913 time to create 1 rle with old method : 0.006596565246582031 time for calcul the mask position with numpy : 0.011085987091064453 nb_pixel_total : 1986 time to create 1 rle with old method : 0.0021970272064208984 time for calcul the mask position with numpy : 0.010514497756958008 nb_pixel_total : 7512 time to create 1 rle with old method : 0.008412837982177734 time for calcul the mask position with numpy : 0.00822901725769043 nb_pixel_total : 14691 time to create 1 rle with old method : 0.01581287384033203 time for calcul the mask position with numpy : 0.00659942626953125 nb_pixel_total : 19392 time to create 1 rle with old method : 0.021547555923461914 time for calcul the mask position with numpy : 0.008625507354736328 nb_pixel_total : 15804 time to create 1 rle with old method : 0.017605066299438477 time for calcul the mask position with numpy : 0.006759166717529297 nb_pixel_total : 8087 time to create 1 rle with old method : 0.009055376052856445 time for calcul the mask position with numpy : 0.006880283355712891 nb_pixel_total : 18295 time to create 1 rle with old method : 0.020998239517211914 time for calcul the mask position with numpy : 0.007230281829833984 nb_pixel_total : 15255 time to create 1 rle with old method : 0.024141550064086914 time for calcul the mask position with numpy : 0.007807493209838867 nb_pixel_total : 37665 time to create 1 rle with old method : 0.04107475280761719 time for calcul the mask position with numpy : 0.006928443908691406 nb_pixel_total : 3796 time to create 1 rle with old method : 0.004176616668701172 time for calcul the mask position with numpy : 0.007033348083496094 nb_pixel_total : 9397 time to create 1 rle with old method : 0.010257720947265625 time for calcul the mask position with numpy : 0.006445169448852539 nb_pixel_total : 4494 time to create 1 rle with old method : 0.006104230880737305 time for calcul the mask position with numpy : 0.006398916244506836 nb_pixel_total : 7759 time to create 1 rle with old method : 0.008528470993041992 time for calcul the mask position with numpy : 0.007602214813232422 nb_pixel_total : 7661 time to create 1 rle with old method : 0.008591890335083008 time for calcul the mask position with numpy : 0.006127834320068359 nb_pixel_total : 12827 time to create 1 rle with old method : 0.014191389083862305 time for calcul the mask position with numpy : 0.006451129913330078 nb_pixel_total : 26746 time to create 1 rle with old method : 0.029545307159423828 time for calcul the mask position with numpy : 0.006792545318603516 nb_pixel_total : 18277 time to create 1 rle with old method : 0.02478766441345215 create new chi : 0.8135941028594971 time to delete rle : 0.05037498474121094 batch 1 Loaded 45 chid ids of type : 4211 Number RLEs to save : 7037 TO DO : save crop sub photo not yet done ! save time : 1.1761209964752197 nb_obj : 27 nb_hashtags : 7 time to prepare the origin masks : 2.575430393218994 time for calcul the mask position with numpy : 0.05565476417541504 nb_pixel_total : 1825711 time to create 1 rle with new method : 0.32792186737060547 time for calcul the mask position with numpy : 0.006009101867675781 nb_pixel_total : 2358 time to create 1 rle with old method : 0.002577066421508789 time for calcul the mask position with numpy : 0.006061553955078125 nb_pixel_total : 17194 time to create 1 rle with old method : 0.018648862838745117 time for calcul the mask position with numpy : 0.0058612823486328125 nb_pixel_total : 4312 time to create 1 rle with old method : 0.0049474239349365234 time for calcul the mask position with numpy : 0.005913972854614258 nb_pixel_total : 11221 time to create 1 rle with old method : 0.012196540832519531 time for calcul the mask position with numpy : 0.005945444107055664 nb_pixel_total : 26627 time to create 1 rle with old method : 0.0332643985748291 time for calcul the mask position with numpy : 0.006616830825805664 nb_pixel_total : 9331 time to create 1 rle with old method : 0.014864921569824219 time for calcul the mask position with numpy : 0.00647425651550293 nb_pixel_total : 119 time to create 1 rle with old method : 0.00033283233642578125 time for calcul the mask position with numpy : 0.006556034088134766 nb_pixel_total : 12582 time to create 1 rle with old method : 0.019726276397705078 time for calcul the mask position with numpy : 0.007455110549926758 nb_pixel_total : 5515 time to create 1 rle with old method : 0.008873462677001953 time for calcul the mask position with numpy : 0.006257057189941406 nb_pixel_total : 25337 time to create 1 rle with old method : 0.027624130249023438 time for calcul the mask position with numpy : 0.0064203739166259766 nb_pixel_total : 4036 time to create 1 rle with old method : 0.004460573196411133 time for calcul the mask position with numpy : 0.006799936294555664 nb_pixel_total : 9392 time to create 1 rle with old method : 0.010286092758178711 time for calcul the mask position with numpy : 0.0065348148345947266 nb_pixel_total : 9249 time to create 1 rle with old method : 0.010243892669677734 time for calcul the mask position with numpy : 0.006732940673828125 nb_pixel_total : 4776 time to create 1 rle with old method : 0.005091667175292969 time for calcul the mask position with numpy : 0.010034561157226562 nb_pixel_total : 9211 time to create 1 rle with old method : 0.009802103042602539 time for calcul the mask position with numpy : 0.010858535766601562 nb_pixel_total : 4544 time to create 1 rle with old method : 0.005224466323852539 time for calcul the mask position with numpy : 0.010389566421508789 nb_pixel_total : 11195 time to create 1 rle with old method : 0.012357473373413086 time for calcul the mask position with numpy : 0.00904703140258789 nb_pixel_total : 5465 time to create 1 rle with old method : 0.00618433952331543 time for calcul the mask position with numpy : 0.00608062744140625 nb_pixel_total : 8379 time to create 1 rle with old method : 0.009016752243041992 time for calcul the mask position with numpy : 0.006348133087158203 nb_pixel_total : 5611 time to create 1 rle with old method : 0.00616145133972168 time for calcul the mask position with numpy : 0.00609135627746582 nb_pixel_total : 12457 time to create 1 rle with old method : 0.014124155044555664 time for calcul the mask position with numpy : 0.0061299800872802734 nb_pixel_total : 14453 time to create 1 rle with old method : 0.015672922134399414 time for calcul the mask position with numpy : 0.0068895816802978516 nb_pixel_total : 3371 time to create 1 rle with old method : 0.0038139820098876953 time for calcul the mask position with numpy : 0.008365154266357422 nb_pixel_total : 9624 time to create 1 rle with old method : 0.01110219955444336 time for calcul the mask position with numpy : 0.008342266082763672 nb_pixel_total : 11395 time to create 1 rle with old method : 0.013006210327148438 time for calcul the mask position with numpy : 0.008489131927490234 nb_pixel_total : 7888 time to create 1 rle with old method : 0.008861780166625977 time for calcul the mask position with numpy : 0.008438587188720703 nb_pixel_total : 2247 time to create 1 rle with old method : 0.0026547908782958984 create new chi : 0.8814632892608643 time to delete rle : 0.0008323192596435547 batch 1 Loaded 55 chid ids of type : 4211 Number RLEs to save : 7125 TO DO : save crop sub photo not yet done ! save time : 0.5658278465270996 nb_obj : 15 nb_hashtags : 6 time to prepare the origin masks : 1.0041661262512207 time for calcul the mask position with numpy : 0.026256561279296875 nb_pixel_total : 1900214 time to create 1 rle with new method : 0.034790754318237305 time for calcul the mask position with numpy : 0.0059854984283447266 nb_pixel_total : 2940 time to create 1 rle with old method : 0.003265380859375 time for calcul the mask position with numpy : 0.006073474884033203 nb_pixel_total : 4362 time to create 1 rle with old method : 0.004654884338378906 time for calcul the mask position with numpy : 0.005819797515869141 nb_pixel_total : 6803 time to create 1 rle with old method : 0.007263660430908203 time for calcul the mask position with numpy : 0.0060367584228515625 nb_pixel_total : 4289 time to create 1 rle with old method : 0.004673480987548828 time for calcul the mask position with numpy : 0.0061740875244140625 nb_pixel_total : 60331 time to create 1 rle with old method : 0.06345868110656738 time for calcul the mask position with numpy : 0.005858659744262695 nb_pixel_total : 24020 time to create 1 rle with old method : 0.024281024932861328 time for calcul the mask position with numpy : 0.0058019161224365234 nb_pixel_total : 9737 time to create 1 rle with old method : 0.01046895980834961 time for calcul the mask position with numpy : 0.0057184696197509766 nb_pixel_total : 2081 time to create 1 rle with old method : 0.002280712127685547 time for calcul the mask position with numpy : 0.005808115005493164 nb_pixel_total : 12316 time to create 1 rle with old method : 0.012781858444213867 time for calcul the mask position with numpy : 0.00554966926574707 nb_pixel_total : 5489 time to create 1 rle with old method : 0.005752086639404297 time for calcul the mask position with numpy : 0.005667686462402344 nb_pixel_total : 1465 time to create 1 rle with old method : 0.0015769004821777344 time for calcul the mask position with numpy : 0.005568742752075195 nb_pixel_total : 11151 time to create 1 rle with old method : 0.011720657348632812 time for calcul the mask position with numpy : 0.006420135498046875 nb_pixel_total : 5005 time to create 1 rle with old method : 0.005651712417602539 time for calcul the mask position with numpy : 0.0057566165924072266 nb_pixel_total : 8715 time to create 1 rle with old method : 0.009233951568603516 time for calcul the mask position with numpy : 0.0058650970458984375 nb_pixel_total : 14682 time to create 1 rle with old method : 0.015527963638305664 create new chi : 0.3326122760772705 time to delete rle : 0.0004813671112060547 batch 1 Loaded 31 chid ids of type : 4211 Number RLEs to save : 5054 TO DO : save crop sub photo not yet done ! save time : 0.6014664173126221 nb_obj : 18 nb_hashtags : 8 time to prepare the origin masks : 1.097661018371582 time for calcul the mask position with numpy : 0.017845630645751953 nb_pixel_total : 1860128 time to create 1 rle with new method : 0.029851675033569336 time for calcul the mask position with numpy : 0.005805015563964844 nb_pixel_total : 6484 time to create 1 rle with old method : 0.006795644760131836 time for calcul the mask position with numpy : 0.00577545166015625 nb_pixel_total : 7990 time to create 1 rle with old method : 0.008774518966674805 time for calcul the mask position with numpy : 0.005766391754150391 nb_pixel_total : 6661 time to create 1 rle with old method : 0.00725555419921875 time for calcul the mask position with numpy : 0.0059969425201416016 nb_pixel_total : 2940 time to create 1 rle with old method : 0.0031385421752929688 time for calcul the mask position with numpy : 0.0062220096588134766 nb_pixel_total : 28403 time to create 1 rle with old method : 0.030154943466186523 time for calcul the mask position with numpy : 0.005961894989013672 nb_pixel_total : 10204 time to create 1 rle with old method : 0.011327981948852539 time for calcul the mask position with numpy : 0.0061876773834228516 nb_pixel_total : 26632 time to create 1 rle with old method : 0.029068946838378906 time for calcul the mask position with numpy : 0.006354331970214844 nb_pixel_total : 9164 time to create 1 rle with old method : 0.01047515869140625 time for calcul the mask position with numpy : 0.006078004837036133 nb_pixel_total : 6817 time to create 1 rle with old method : 0.007458686828613281 time for calcul the mask position with numpy : 0.006274223327636719 nb_pixel_total : 7726 time to create 1 rle with old method : 0.008526325225830078 time for calcul the mask position with numpy : 0.005898475646972656 nb_pixel_total : 2061 time to create 1 rle with old method : 0.0023806095123291016 time for calcul the mask position with numpy : 0.005931854248046875 nb_pixel_total : 11615 time to create 1 rle with old method : 0.01297903060913086 time for calcul the mask position with numpy : 0.006256103515625 nb_pixel_total : 41002 time to create 1 rle with old method : 0.04427456855773926 time for calcul the mask position with numpy : 0.005979299545288086 nb_pixel_total : 7684 time to create 1 rle with old method : 0.00826406478881836 time for calcul the mask position with numpy : 0.006003856658935547 nb_pixel_total : 17114 time to create 1 rle with old method : 0.01801609992980957 time for calcul the mask position with numpy : 0.005914926528930664 nb_pixel_total : 4460 time to create 1 rle with old method : 0.004842996597290039 time for calcul the mask position with numpy : 0.005672931671142578 nb_pixel_total : 1833 time to create 1 rle with old method : 0.0019114017486572266 time for calcul the mask position with numpy : 0.0058324337005615234 nb_pixel_total : 14682 time to create 1 rle with old method : 0.015615701675415039 create new chi : 0.3878903388977051 time to delete rle : 0.000553131103515625 batch 1 Loaded 37 chid ids of type : 4211 Number RLEs to save : 5766 TO DO : save crop sub photo not yet done ! save time : 0.5634727478027344 nb_obj : 23 nb_hashtags : 7 time to prepare the origin masks : 2.0823538303375244 time for calcul the mask position with numpy : 0.04966878890991211 nb_pixel_total : 1845365 time to create 1 rle with new method : 0.6501035690307617 time for calcul the mask position with numpy : 0.007088899612426758 nb_pixel_total : 4601 time to create 1 rle with old method : 0.005242347717285156 time for calcul the mask position with numpy : 0.00599360466003418 nb_pixel_total : 6616 time to create 1 rle with old method : 0.007194995880126953 time for calcul the mask position with numpy : 0.006601572036743164 nb_pixel_total : 11559 time to create 1 rle with old method : 0.012668132781982422 time for calcul the mask position with numpy : 0.006403446197509766 nb_pixel_total : 31355 time to create 1 rle with old method : 0.0338134765625 time for calcul the mask position with numpy : 0.006291389465332031 nb_pixel_total : 26511 time to create 1 rle with old method : 0.028543710708618164 time for calcul the mask position with numpy : 0.006041049957275391 nb_pixel_total : 3044 time to create 1 rle with old method : 0.0033915042877197266 time for calcul the mask position with numpy : 0.006229877471923828 nb_pixel_total : 4443 time to create 1 rle with old method : 0.004973411560058594 time for calcul the mask position with numpy : 0.0059702396392822266 nb_pixel_total : 8566 time to create 1 rle with old method : 0.009184122085571289 time for calcul the mask position with numpy : 0.006218910217285156 nb_pixel_total : 15191 time to create 1 rle with old method : 0.016726255416870117 time for calcul the mask position with numpy : 0.006119489669799805 nb_pixel_total : 3005 time to create 1 rle with old method : 0.0034546852111816406 time for calcul the mask position with numpy : 0.006010532379150391 nb_pixel_total : 1768 time to create 1 rle with old method : 0.002048015594482422 time for calcul the mask position with numpy : 0.005823373794555664 nb_pixel_total : 8816 time to create 1 rle with old method : 0.009474754333496094 time for calcul the mask position with numpy : 0.00595855712890625 nb_pixel_total : 9975 time to create 1 rle with old method : 0.011009454727172852 time for calcul the mask position with numpy : 0.005803823471069336 nb_pixel_total : 3512 time to create 1 rle with old method : 0.003848552703857422 time for calcul the mask position with numpy : 0.006069183349609375 nb_pixel_total : 10348 time to create 1 rle with old method : 0.011201858520507812 time for calcul the mask position with numpy : 0.00592803955078125 nb_pixel_total : 6185 time to create 1 rle with old method : 0.00652313232421875 time for calcul the mask position with numpy : 0.005820274353027344 nb_pixel_total : 7150 time to create 1 rle with old method : 0.007718086242675781 time for calcul the mask position with numpy : 0.0061419010162353516 nb_pixel_total : 17706 time to create 1 rle with old method : 0.018783092498779297 time for calcul the mask position with numpy : 0.0060117244720458984 nb_pixel_total : 17480 time to create 1 rle with old method : 0.01856851577758789 time for calcul the mask position with numpy : 0.005989789962768555 nb_pixel_total : 4817 time to create 1 rle with old method : 0.0054280757904052734 time for calcul the mask position with numpy : 0.005832672119140625 nb_pixel_total : 6021 time to create 1 rle with old method : 0.006754875183105469 time for calcul the mask position with numpy : 0.0058557987213134766 nb_pixel_total : 5447 time to create 1 rle with old method : 0.006155729293823242 time for calcul the mask position with numpy : 0.006432294845581055 nb_pixel_total : 14119 time to create 1 rle with old method : 0.01593613624572754 create new chi : 1.0998470783233643 time to delete rle : 0.0008084774017333984 batch 1 Loaded 45 chid ids of type : 4211 Number RLEs to save : 7076 TO DO : save crop sub photo not yet done ! save time : 0.784480094909668 nb_obj : 28 nb_hashtags : 9 time to prepare the origin masks : 2.4943344593048096 time for calcul the mask position with numpy : 0.05059170722961426 nb_pixel_total : 1771106 time to create 1 rle with new method : 0.3096041679382324 time for calcul the mask position with numpy : 0.00616765022277832 nb_pixel_total : 2594 time to create 1 rle with old method : 0.0031011104583740234 time for calcul the mask position with numpy : 0.0060269832611083984 nb_pixel_total : 3122 time to create 1 rle with old method : 0.0033502578735351562 time for calcul the mask position with numpy : 0.006015777587890625 nb_pixel_total : 13162 time to create 1 rle with old method : 0.013996362686157227 time for calcul the mask position with numpy : 0.0063250064849853516 nb_pixel_total : 11716 time to create 1 rle with old method : 0.013292789459228516 time for calcul the mask position with numpy : 0.006020784378051758 nb_pixel_total : 2714 time to create 1 rle with old method : 0.0029938220977783203 time for calcul the mask position with numpy : 0.006087064743041992 nb_pixel_total : 13511 time to create 1 rle with old method : 0.014796733856201172 time for calcul the mask position with numpy : 0.0061016082763671875 nb_pixel_total : 21348 time to create 1 rle with old method : 0.02443695068359375 time for calcul the mask position with numpy : 0.006090402603149414 nb_pixel_total : 11172 time to create 1 rle with old method : 0.01210165023803711 time for calcul the mask position with numpy : 0.0060231685638427734 nb_pixel_total : 21672 time to create 1 rle with old method : 0.024588823318481445 time for calcul the mask position with numpy : 0.005928516387939453 nb_pixel_total : 3733 time to create 1 rle with old method : 0.004027366638183594 time for calcul the mask position with numpy : 0.005980014801025391 nb_pixel_total : 7691 time to create 1 rle with old method : 0.008835315704345703 time for calcul the mask position with numpy : 0.006025552749633789 nb_pixel_total : 19149 time to create 1 rle with old method : 0.02107691764831543 time for calcul the mask position with numpy : 0.006032705307006836 nb_pixel_total : 14322 time to create 1 rle with old method : 0.015521764755249023 time for calcul the mask position with numpy : 0.006177186965942383 nb_pixel_total : 15811 time to create 1 rle with old method : 0.017061948776245117 time for calcul the mask position with numpy : 0.006082057952880859 nb_pixel_total : 20229 time to create 1 rle with old method : 0.02208852767944336 time for calcul the mask position with numpy : 0.006208658218383789 nb_pixel_total : 31011 time to create 1 rle with old method : 0.03345823287963867 time for calcul the mask position with numpy : 0.0061147212982177734 nb_pixel_total : 10970 time to create 1 rle with old method : 0.011697530746459961 time for calcul the mask position with numpy : 0.0060389041900634766 nb_pixel_total : 13928 time to create 1 rle with old method : 0.015294075012207031 time for calcul the mask position with numpy : 0.006075382232666016 nb_pixel_total : 4505 time to create 1 rle with old method : 0.004895687103271484 time for calcul the mask position with numpy : 0.006024599075317383 nb_pixel_total : 11363 time to create 1 rle with old method : 0.012404918670654297 time for calcul the mask position with numpy : 0.006039142608642578 nb_pixel_total : 5573 time to create 1 rle with old method : 0.0059778690338134766 time for calcul the mask position with numpy : 0.0058553218841552734 nb_pixel_total : 6249 time to create 1 rle with old method : 0.006592512130737305 time for calcul the mask position with numpy : 0.006023406982421875 nb_pixel_total : 4156 time to create 1 rle with old method : 0.004604339599609375 time for calcul the mask position with numpy : 0.008154630661010742 nb_pixel_total : 5498 time to create 1 rle with old method : 0.006183147430419922 time for calcul the mask position with numpy : 0.008114099502563477 nb_pixel_total : 4239 time to create 1 rle with old method : 0.004732370376586914 time for calcul the mask position with numpy : 0.008206605911254883 nb_pixel_total : 5876 time to create 1 rle with old method : 0.008356332778930664 time for calcul the mask position with numpy : 0.009722709655761719 nb_pixel_total : 13337 time to create 1 rle with old method : 0.020855426788330078 time for calcul the mask position with numpy : 0.009670019149780273 nb_pixel_total : 3843 time to create 1 rle with old method : 0.006079912185668945 create new chi : 0.8977012634277344 time to delete rle : 0.0012156963348388672 batch 1 Loaded 56 chid ids of type : 4211 Number RLEs to save : 8587 TO DO : save crop sub photo not yet done ! save time : 1.9188017845153809 nb_obj : 17 nb_hashtags : 7 time to prepare the origin masks : 1.0669095516204834 time for calcul the mask position with numpy : 0.01780247688293457 nb_pixel_total : 1916683 time to create 1 rle with new method : 0.029796361923217773 time for calcul the mask position with numpy : 0.00573420524597168 nb_pixel_total : 2519 time to create 1 rle with old method : 0.002618551254272461 time for calcul the mask position with numpy : 0.005640983581542969 nb_pixel_total : 9683 time to create 1 rle with old method : 0.010254144668579102 time for calcul the mask position with numpy : 0.005992412567138672 nb_pixel_total : 6153 time to create 1 rle with old method : 0.0067942142486572266 time for calcul the mask position with numpy : 0.006052494049072266 nb_pixel_total : 18536 time to create 1 rle with old method : 0.02016425132751465 time for calcul the mask position with numpy : 0.005987644195556641 nb_pixel_total : 2410 time to create 1 rle with old method : 0.0026900768280029297 time for calcul the mask position with numpy : 0.005817890167236328 nb_pixel_total : 3832 time to create 1 rle with old method : 0.0041348934173583984 time for calcul the mask position with numpy : 0.006000995635986328 nb_pixel_total : 8818 time to create 1 rle with old method : 0.009578466415405273 time for calcul the mask position with numpy : 0.006089687347412109 nb_pixel_total : 11897 time to create 1 rle with old method : 0.013175249099731445 time for calcul the mask position with numpy : 0.006367921829223633 nb_pixel_total : 7630 time to create 1 rle with old method : 0.008332967758178711 time for calcul the mask position with numpy : 0.005925416946411133 nb_pixel_total : 8297 time to create 1 rle with old method : 0.00878453254699707 time for calcul the mask position with numpy : 0.005979299545288086 nb_pixel_total : 11656 time to create 1 rle with old method : 0.012327194213867188 time for calcul the mask position with numpy : 0.005903005599975586 nb_pixel_total : 20662 time to create 1 rle with old method : 0.021860837936401367 time for calcul the mask position with numpy : 0.005896329879760742 nb_pixel_total : 10484 time to create 1 rle with old method : 0.011188745498657227 time for calcul the mask position with numpy : 0.005728483200073242 nb_pixel_total : 8529 time to create 1 rle with old method : 0.008986234664916992 time for calcul the mask position with numpy : 0.00584721565246582 nb_pixel_total : 3622 time to create 1 rle with old method : 0.004021883010864258 time for calcul the mask position with numpy : 0.005934476852416992 nb_pixel_total : 3890 time to create 1 rle with old method : 0.004329681396484375 time for calcul the mask position with numpy : 0.0061953067779541016 nb_pixel_total : 18299 time to create 1 rle with old method : 0.020312070846557617 create new chi : 0.31917667388916016 time to delete rle : 0.0005376338958740234 batch 1 Loaded 35 chid ids of type : 4211 Number RLEs to save : 5285 TO DO : save crop sub photo not yet done ! save time : 0.7705519199371338 nb_obj : 22 nb_hashtags : 6 time to prepare the origin masks : 1.955092430114746 time for calcul the mask position with numpy : 0.03463292121887207 nb_pixel_total : 1908739 time to create 1 rle with new method : 0.04787921905517578 time for calcul the mask position with numpy : 0.0060040950775146484 nb_pixel_total : 2444 time to create 1 rle with old method : 0.002748727798461914 time for calcul the mask position with numpy : 0.005723714828491211 nb_pixel_total : 3238 time to create 1 rle with old method : 0.0035736560821533203 time for calcul the mask position with numpy : 0.00579071044921875 nb_pixel_total : 1666 time to create 1 rle with old method : 0.0018439292907714844 time for calcul the mask position with numpy : 0.005712032318115234 nb_pixel_total : 16132 time to create 1 rle with old method : 0.01691746711730957 time for calcul the mask position with numpy : 0.006044864654541016 nb_pixel_total : 1430 time to create 1 rle with old method : 0.0015044212341308594 time for calcul the mask position with numpy : 0.00571441650390625 nb_pixel_total : 11248 time to create 1 rle with old method : 0.011823177337646484 time for calcul the mask position with numpy : 0.005696773529052734 nb_pixel_total : 5222 time to create 1 rle with old method : 0.005420684814453125 time for calcul the mask position with numpy : 0.005688667297363281 nb_pixel_total : 1954 time to create 1 rle with old method : 0.002090930938720703 time for calcul the mask position with numpy : 0.0057070255279541016 nb_pixel_total : 5847 time to create 1 rle with old method : 0.006544828414916992 time for calcul the mask position with numpy : 0.005701541900634766 nb_pixel_total : 4184 time to create 1 rle with old method : 0.004625082015991211 time for calcul the mask position with numpy : 0.005910634994506836 nb_pixel_total : 5380 time to create 1 rle with old method : 0.005724191665649414 time for calcul the mask position with numpy : 0.005854368209838867 nb_pixel_total : 1912 time to create 1 rle with old method : 0.0021576881408691406 time for calcul the mask position with numpy : 0.006045818328857422 nb_pixel_total : 2574 time to create 1 rle with old method : 0.0027761459350585938 time for calcul the mask position with numpy : 0.006169319152832031 nb_pixel_total : 3612 time to create 1 rle with old method : 0.004080533981323242 time for calcul the mask position with numpy : 0.006417989730834961 nb_pixel_total : 12450 time to create 1 rle with old method : 0.013623237609863281 time for calcul the mask position with numpy : 0.006462812423706055 nb_pixel_total : 14905 time to create 1 rle with old method : 0.016513824462890625 time for calcul the mask position with numpy : 0.00619196891784668 nb_pixel_total : 16901 time to create 1 rle with old method : 0.018749713897705078 time for calcul the mask position with numpy : 0.006228446960449219 nb_pixel_total : 13337 time to create 1 rle with old method : 0.014917373657226562 time for calcul the mask position with numpy : 0.005873441696166992 nb_pixel_total : 8640 time to create 1 rle with old method : 0.010034799575805664 time for calcul the mask position with numpy : 0.00619816780090332 nb_pixel_total : 6402 time to create 1 rle with old method : 0.006917715072631836 time for calcul the mask position with numpy : 0.006258249282836914 nb_pixel_total : 10271 time to create 1 rle with old method : 0.011310100555419922 time for calcul the mask position with numpy : 0.0062236785888671875 nb_pixel_total : 15112 time to create 1 rle with old method : 0.016079425811767578 create new chi : 0.39551830291748047 time to delete rle : 0.0007498264312744141 batch 1 Loaded 45 chid ids of type : 4211 Number RLEs to save : 6336 TO DO : save crop sub photo not yet done ! save time : 0.45211076736450195 nb_obj : 33 nb_hashtags : 9 time to prepare the origin masks : 3.054795026779175 time for calcul the mask position with numpy : 0.05237746238708496 nb_pixel_total : 1717411 time to create 1 rle with new method : 0.29457640647888184 time for calcul the mask position with numpy : 0.00637507438659668 nb_pixel_total : 7383 time to create 1 rle with old method : 0.008219480514526367 time for calcul the mask position with numpy : 0.0061550140380859375 nb_pixel_total : 4736 time to create 1 rle with old method : 0.005145072937011719 time for calcul the mask position with numpy : 0.006118059158325195 nb_pixel_total : 6753 time to create 1 rle with old method : 0.0074977874755859375 time for calcul the mask position with numpy : 0.0060214996337890625 nb_pixel_total : 12212 time to create 1 rle with old method : 0.013220548629760742 time for calcul the mask position with numpy : 0.006036043167114258 nb_pixel_total : 14385 time to create 1 rle with old method : 0.016230106353759766 time for calcul the mask position with numpy : 0.0061647891998291016 nb_pixel_total : 8849 time to create 1 rle with old method : 0.009700298309326172 time for calcul the mask position with numpy : 0.006157636642456055 nb_pixel_total : 8700 time to create 1 rle with old method : 0.009396076202392578 time for calcul the mask position with numpy : 0.006651401519775391 nb_pixel_total : 67618 time to create 1 rle with old method : 0.0725560188293457 time for calcul the mask position with numpy : 0.006173133850097656 nb_pixel_total : 9441 time to create 1 rle with old method : 0.010236740112304688 time for calcul the mask position with numpy : 0.006862640380859375 nb_pixel_total : 16784 time to create 1 rle with old method : 0.018444538116455078 time for calcul the mask position with numpy : 0.007044792175292969 nb_pixel_total : 2046 time to create 1 rle with old method : 0.0023136138916015625 time for calcul the mask position with numpy : 0.006508827209472656 nb_pixel_total : 5828 time to create 1 rle with old method : 0.006601572036743164 time for calcul the mask position with numpy : 0.006175518035888672 nb_pixel_total : 10954 time to create 1 rle with old method : 0.011921405792236328 time for calcul the mask position with numpy : 0.006150007247924805 nb_pixel_total : 14407 time to create 1 rle with old method : 0.016264677047729492 time for calcul the mask position with numpy : 0.0059032440185546875 nb_pixel_total : 4138 time to create 1 rle with old method : 0.004804849624633789 time for calcul the mask position with numpy : 0.006638288497924805 nb_pixel_total : 8864 time to create 1 rle with old method : 0.009840965270996094 time for calcul the mask position with numpy : 0.007033824920654297 nb_pixel_total : 7799 time to create 1 rle with old method : 0.008875608444213867 time for calcul the mask position with numpy : 0.006803750991821289 nb_pixel_total : 19729 time to create 1 rle with old method : 0.027211666107177734 time for calcul the mask position with numpy : 0.0066509246826171875 nb_pixel_total : 6319 time to create 1 rle with old method : 0.010082483291625977 time for calcul the mask position with numpy : 0.006516456604003906 nb_pixel_total : 3578 time to create 1 rle with old method : 0.005986690521240234 time for calcul the mask position with numpy : 0.006868124008178711 nb_pixel_total : 5568 time to create 1 rle with old method : 0.008904695510864258 time for calcul the mask position with numpy : 0.006973981857299805 nb_pixel_total : 2794 time to create 1 rle with old method : 0.004556179046630859 time for calcul the mask position with numpy : 0.007674455642700195 nb_pixel_total : 4209 time to create 1 rle with old method : 0.005459785461425781 time for calcul the mask position with numpy : 0.006743431091308594 nb_pixel_total : 4072 time to create 1 rle with old method : 0.0045833587646484375 time for calcul the mask position with numpy : 0.006106376647949219 nb_pixel_total : 5519 time to create 1 rle with old method : 0.005904674530029297 time for calcul the mask position with numpy : 0.006146669387817383 nb_pixel_total : 11943 time to create 1 rle with old method : 0.012877702713012695 time for calcul the mask position with numpy : 0.008295297622680664 nb_pixel_total : 5959 time to create 1 rle with old method : 0.006707191467285156 time for calcul the mask position with numpy : 0.00816655158996582 nb_pixel_total : 16722 time to create 1 rle with old method : 0.018609285354614258 time for calcul the mask position with numpy : 0.008519411087036133 nb_pixel_total : 14043 time to create 1 rle with old method : 0.015044927597045898 time for calcul the mask position with numpy : 0.008499622344970703 nb_pixel_total : 28690 time to create 1 rle with old method : 0.03189587593078613 time for calcul the mask position with numpy : 0.008283138275146484 nb_pixel_total : 4637 time to create 1 rle with old method : 0.005186796188354492 time for calcul the mask position with numpy : 0.008520126342773438 nb_pixel_total : 7482 time to create 1 rle with old method : 0.008629322052001953 time for calcul the mask position with numpy : 0.008541107177734375 nb_pixel_total : 4028 time to create 1 rle with old method : 0.004678249359130859 create new chi : 0.9936795234680176 time to delete rle : 0.0009815692901611328 batch 1 Loaded 68 chid ids of type : 4211 Number RLEs to save : 9905 TO DO : save crop sub photo not yet done ! save time : 1.0097432136535645 nb_obj : 28 nb_hashtags : 9 time to prepare the origin masks : 3.960477352142334 time for calcul the mask position with numpy : 0.026083946228027344 nb_pixel_total : 1696303 time to create 1 rle with new method : 0.06132030487060547 time for calcul the mask position with numpy : 0.010189533233642578 nb_pixel_total : 2253 time to create 1 rle with old method : 0.0025069713592529297 time for calcul the mask position with numpy : 0.010184764862060547 nb_pixel_total : 3286 time to create 1 rle with old method : 0.003831148147583008 time for calcul the mask position with numpy : 0.006155967712402344 nb_pixel_total : 8287 time to create 1 rle with old method : 0.008823633193969727 time for calcul the mask position with numpy : 0.010591506958007812 nb_pixel_total : 12965 time to create 1 rle with old method : 0.013987302780151367 time for calcul the mask position with numpy : 0.006757497787475586 nb_pixel_total : 46124 time to create 1 rle with old method : 0.05211162567138672 time for calcul the mask position with numpy : 0.0072782039642333984 nb_pixel_total : 7244 time to create 1 rle with old method : 0.008281707763671875 time for calcul the mask position with numpy : 0.006758928298950195 nb_pixel_total : 5682 time to create 1 rle with old method : 0.00677490234375 time for calcul the mask position with numpy : 0.01049494743347168 nb_pixel_total : 3577 time to create 1 rle with old method : 0.004004478454589844 time for calcul the mask position with numpy : 0.010703563690185547 nb_pixel_total : 10357 time to create 1 rle with old method : 0.011821269989013672 time for calcul the mask position with numpy : 0.010770082473754883 nb_pixel_total : 39355 time to create 1 rle with old method : 0.04755830764770508 time for calcul the mask position with numpy : 0.010101556777954102 nb_pixel_total : 12519 time to create 1 rle with old method : 0.013636350631713867 time for calcul the mask position with numpy : 0.009851455688476562 nb_pixel_total : 5335 time to create 1 rle with old method : 0.0057525634765625 time for calcul the mask position with numpy : 0.009626388549804688 nb_pixel_total : 14026 time to create 1 rle with old method : 0.015219449996948242 time for calcul the mask position with numpy : 0.010918617248535156 nb_pixel_total : 7399 time to create 1 rle with old method : 0.008079767227172852 time for calcul the mask position with numpy : 0.010486841201782227 nb_pixel_total : 11832 time to create 1 rle with old method : 0.014805078506469727 time for calcul the mask position with numpy : 0.010395050048828125 nb_pixel_total : 23638 time to create 1 rle with old method : 0.02559661865234375 time for calcul the mask position with numpy : 0.010152101516723633 nb_pixel_total : 12702 time to create 1 rle with old method : 0.01342916488647461 time for calcul the mask position with numpy : 0.01001286506652832 nb_pixel_total : 21489 time to create 1 rle with old method : 0.023099184036254883 time for calcul the mask position with numpy : 0.0059108734130859375 nb_pixel_total : 15215 time to create 1 rle with old method : 0.015646696090698242 time for calcul the mask position with numpy : 0.005916118621826172 nb_pixel_total : 13018 time to create 1 rle with old method : 0.014184951782226562 time for calcul the mask position with numpy : 0.0058667659759521484 nb_pixel_total : 7068 time to create 1 rle with old method : 0.007227420806884766 time for calcul the mask position with numpy : 0.005803823471069336 nb_pixel_total : 866 time to create 1 rle with old method : 0.0009951591491699219 time for calcul the mask position with numpy : 0.006153583526611328 nb_pixel_total : 49193 time to create 1 rle with old method : 0.05424666404724121 time for calcul the mask position with numpy : 0.0064029693603515625 nb_pixel_total : 3133 time to create 1 rle with old method : 0.003510713577270508 time for calcul the mask position with numpy : 0.006239652633666992 nb_pixel_total : 19543 time to create 1 rle with old method : 0.0211336612701416 time for calcul the mask position with numpy : 0.006349325180053711 nb_pixel_total : 616 time to create 1 rle with old method : 0.0007512569427490234 time for calcul the mask position with numpy : 0.006295680999755859 nb_pixel_total : 13193 time to create 1 rle with old method : 0.015617847442626953 time for calcul the mask position with numpy : 0.006585836410522461 nb_pixel_total : 7382 time to create 1 rle with old method : 0.007974863052368164 create new chi : 0.7428109645843506 time to delete rle : 0.0009903907775878906 batch 1 Loaded 57 chid ids of type : 4211 Number RLEs to save : 9050 TO DO : save crop sub photo not yet done ! save time : 0.8156237602233887 map_output_result : {1330317086: (0.0, 'Should be the crop_list due to order', 0.0), 1330317082: (0.0, 'Should be the crop_list due to order', 0.0), 1330317079: (0.0, 'Should be the crop_list due to order', 0.0), 1330317076: (0.0, 'Should be the crop_list due to order', 0.0), 1330317073: (0.0, 'Should be the crop_list due to order', 0.0), 1330317070: (0.0, 'Should be the crop_list due to order', 0.0), 1330317036: (0.0, 'Should be the crop_list due to order', 0.0), 1330317028: (0.0, 'Should be the crop_list due to order', 0.0), 1330317014: (0.0, 'Should be the crop_list due to order', 0.0), 1330317011: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1330317086, 1330317082, 1330317079, 1330317076, 1330317073, 1330317070, 1330317036, 1330317028, 1330317014, 1330317011] Looping around the photos to save general results len do output : 10 /1330317086.Didn't retrieve data . /1330317082.Didn't retrieve data . /1330317079.Didn't retrieve data . /1330317076.Didn't retrieve data . /1330317073.Didn't retrieve data . /1330317070.Didn't retrieve data . /1330317036.Didn't retrieve data . /1330317028.Didn't retrieve data . /1330317014.Didn't retrieve data . /1330317011.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317086', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317082', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317079', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317076', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317073', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317070', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317036', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317028', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317014', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317011', None, None, None, None, None, '2533520') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.014934062957763672 save_final save missing photos in datou_result : time spend for datou_step_exec : 40.60737490653992 time spend to save output : 0.015605688095092773 total time spend for step 8 : 40.62298059463501 step9:crop_condition Sat Feb 1 02:08:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4211 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 474 chid ids of type : 4211 begin to crop the class : barquette_opaque param for this class : {'min_score': 0.5} filtre for class : barquette_opaque hashtag_id of this class : 2107760128 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 61 About to insert : list_path_to_insert length 61 new photo from crops ! About to upload 61 photos upload in portfolio : 4869462 init cache_photo without model_param we have 61 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738372116_2640705 we have uploaded 61 photos in the portfolio 4869462 time of upload the photos Elapsed time : 18.16800880432129 we have finished the crop for the class : barquette_opaque begin to crop the class : carton param for this class : {'min_score': 0.5} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 4869462 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738372134_2640705 we have uploaded 3 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.0570378303527832 we have finished the crop for the class : carton begin to crop the class : ela param for this class : {'min_score': 0.5} filtre for class : ela hashtag_id of this class : 492741797 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738372136_2640705 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.6369857788085938 we have finished the crop for the class : ela begin to crop the class : environnement param for this class : {'min_score': 0.5} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738372137_2640705 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.4793283939361572 we have finished the crop for the class : environnement begin to crop the class : etiquette param for this class : {'min_score': 0.5} filtre for class : etiquette hashtag_id of this class : 492636447 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 43 About to insert : list_path_to_insert length 43 new photo from crops ! About to upload 43 photos upload in portfolio : 4869462 init cache_photo without model_param we have 43 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738372140_2640705 we have uploaded 43 photos in the portfolio 4869462 time of upload the photos Elapsed time : 12.077945470809937 we have finished the crop for the class : etiquette begin to crop the class : film_plastique param for this class : {'min_score': 0.5} filtre for class : film_plastique hashtag_id of this class : 2107756122 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 4869462 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738372153_2640705 we have uploaded 13 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.423079252243042 we have finished the crop for the class : film_plastique begin to crop the class : kraft param for this class : {'min_score': 0.5} filtre for class : kraft hashtag_id of this class : 493202403 begin to crop the class : metal param for this class : {'min_score': 0.5} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 4869462 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738372157_2640705 we have uploaded 9 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.3381998538970947 we have finished the crop for the class : metal begin to crop the class : pehd param for this class : {'min_score': 0.5} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 4869462 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738372219_2640705 we have uploaded 10 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.587780237197876 we have finished the crop for the class : pehd begin to crop the class : pet_clair param for this class : {'min_score': 0.5} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738372224_2640705 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.7062036991119385 we have finished the crop for the class : pet_clair begin to crop the class : pet_opaque param for this class : {'min_score': 0.5} filtre for class : pet_opaque hashtag_id of this class : 2107759152 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 4869462 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738372226_2640705 we have uploaded 8 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.138436794281006 we have finished the crop for the class : pet_opaque begin to crop the class : textiles_sanitaires param for this class : {'min_score': 0.5} filtre for class : textiles_sanitaires hashtag_id of this class : 2107760129 begin to crop the class : pet_fonce param for this class : {'min_score': 0.5} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 4869462 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738372229_2640705 we have uploaded 4 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.367656946182251 we have finished the crop for the class : pet_fonce begin to crop the class : papier param for this class : {'min_score': 0.5} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 4869462 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738372232_2640705 we have uploaded 24 photos in the portfolio 4869462 time of upload the photos Elapsed time : 7.920025825500488 we have finished the crop for the class : papier delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1330317086, 1330317082, 1330317079, 1330317076, 1330317073, 1330317070, 1330317036, 1330317028, 1330317014, 1330317011] Looping around the photos to save general results len do output : 179 /1333547617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333547768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333548475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317086', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317082', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317079', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317076', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317073', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317070', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317036', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317028', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317014', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317011', None, None, None, None, None, '2533520') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 547 time used for this insertion : 0.04269146919250488 save_final save missing photos in datou_result : time spend for datou_step_exec : 129.9884798526764 time spend to save output : 0.0476229190826416 total time spend for step 9 : 130.03610277175903 step10:ventilate_hashtags_in_portfolio Sat Feb 1 02:10:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 19777203 get user id for portfolio 19777203 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777203 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','textiles_sanitaires','pehd','pet_clair','ela','mal_croppe','flou','barquette_opaque','etiquette','papier','kraft','carton','pet_opaque','film_plastique','metal','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777203 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','textiles_sanitaires','pehd','pet_clair','ela','mal_croppe','flou','barquette_opaque','etiquette','papier','kraft','carton','pet_opaque','film_plastique','metal','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/19798960,19798961,19798962,19798963,19798964,19798965,19798966,19798967,19798968,19798969,19798970,19798971,19798972,19798973,19798974,19798975?tags=mal_croppe,environnement,kraft,etiquette,pet_opaque,metal,pet_clair,film_plastique,textiles_sanitaires,papier,carton,pehd,pet_fonce,barquette_opaque,flou,ela Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1330317086, 1330317082, 1330317079, 1330317076, 1330317073, 1330317070, 1330317036, 1330317028, 1330317014, 1330317011] Looping around the photos to save general results len do output : 1 /19777203. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317086', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317082', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317079', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317076', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317073', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317070', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317036', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317028', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317014', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317011', None, None, None, None, None, '2533520') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.016465187072753906 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.216167449951172 time spend to save output : 0.01699662208557129 total time spend for step 10 : 4.233164072036743 step11:final Sat Feb 1 02:10:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1330317086: ('0.04190112060013058',), 1330317082: ('0.04190112060013058',), 1330317079: ('0.04190112060013058',), 1330317076: ('0.04190112060013058',), 1330317073: ('0.04190112060013058',), 1330317070: ('0.04190112060013058',), 1330317036: ('0.04190112060013058',), 1330317028: ('0.04190112060013058',), 1330317014: ('0.04190112060013058',), 1330317011: ('0.04190112060013058',)} new output for save of step final : {1330317086: ('0.04190112060013058',), 1330317082: ('0.04190112060013058',), 1330317079: ('0.04190112060013058',), 1330317076: ('0.04190112060013058',), 1330317073: ('0.04190112060013058',), 1330317070: ('0.04190112060013058',), 1330317036: ('0.04190112060013058',), 1330317028: ('0.04190112060013058',), 1330317014: ('0.04190112060013058',), 1330317011: ('0.04190112060013058',)} [1330317086, 1330317082, 1330317079, 1330317076, 1330317073, 1330317070, 1330317036, 1330317028, 1330317014, 1330317011] Looping around the photos to save general results len do output : 10 /1330317086.Didn't retrieve data . /1330317082.Didn't retrieve data . /1330317079.Didn't retrieve data . /1330317076.Didn't retrieve data . /1330317073.Didn't retrieve data . /1330317070.Didn't retrieve data . /1330317036.Didn't retrieve data . /1330317028.Didn't retrieve data . /1330317014.Didn't retrieve data . /1330317011.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317086', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317082', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317079', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317076', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317073', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317070', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317036', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317028', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317014', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317011', None, None, None, None, None, '2533520') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.012990951538085938 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.6332652568817139 time spend to save output : 0.013577938079833984 total time spend for step 11 : 0.6468431949615479 step12:velours_tree Sat Feb 1 02:10:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.06452250480651855 time spend to save output : 9.465217590332031e-05 total time spend for step 12 : 0.06461715698242188 step13:send_mail_cod Sat Feb 1 02:10:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P19777203_01-02-2025_02_10_46.pdf 19798960 imagette197989601738372246 19798962 imagette197989621738372246 19798963 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197989631738372246 19798964 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197989641738372247 19798965 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197989651738372247 19798966 change filename to text .change filename to text .imagette197989661738372247 19798967 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197989671738372247 19798968 imagette197989681738372249 19798969 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197989691738372249 19798970 change filename to text .change filename to text .change filename to text .imagette197989701738372250 19798972 change filename to text .change filename to text .change filename to text .change filename to text .imagette197989721738372250 19798973 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197989731738372250 19798974 imagette197989741738372251 19798975 change filename to text .imagette197989751738372251 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=19777203 and hashtag_type = 4211 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/19798960,19798961,19798962,19798963,19798964,19798965,19798966,19798967,19798968,19798969,19798970,19798971,19798972,19798973,19798974,19798975?tags=mal_croppe,environnement,kraft,etiquette,pet_opaque,metal,pet_clair,film_plastique,textiles_sanitaires,papier,carton,pehd,pet_fonce,barquette_opaque,flou,ela your option no_mail is active, we will not send the real mail to your client args[1330317086] : ((1330317086, -3.0453595383119976, 492609224), (1330317086, -0.0862600104270634, 496442774), '0.04190112060013058') We are sending mail with results at report@fotonower.com args[1330317082] : ((1330317082, -3.226522395187296, 492609224), (1330317082, -0.11792398493357396, 496442774), '0.04190112060013058') We are sending mail with results at report@fotonower.com args[1330317079] : ((1330317079, -2.9695769141733948, 492609224), (1330317079, -0.33582100054414143, 496442774), '0.04190112060013058') We are sending mail with results at report@fotonower.com args[1330317076] : ((1330317076, -3.426796326532357, 492609224), (1330317076, -0.3262618464341023, 496442774), '0.04190112060013058') We are sending mail with results at report@fotonower.com args[1330317073] : ((1330317073, -5.48328357327672, 492609224), (1330317073, -0.1262666539136549, 496442774), '0.04190112060013058') We are sending mail with results at report@fotonower.com args[1330317070] : ((1330317070, -6.507696139385589, 492609224), (1330317070, -0.14341805946083613, 496442774), '0.04190112060013058') We are sending mail with results at report@fotonower.com args[1330317036] : ((1330317036, -2.5286369390486705, 492609224), (1330317036, -0.1423452580127859, 496442774), '0.04190112060013058') We are sending mail with results at report@fotonower.com args[1330317028] : ((1330317028, -0.5023191939389257, 492688767), (1330317028, -0.29856718903132623, 496442774), '0.04190112060013058') We are sending mail with results at report@fotonower.com args[1330317014] : ((1330317014, -2.377751217837267, 492609224), (1330317014, -0.1642822063798797, 496442774), '0.04190112060013058') We are sending mail with results at report@fotonower.com args[1330317011] : ((1330317011, -0.5522058527229204, 492688767), (1330317011, -0.09757718873375369, 496442774), '0.04190112060013058') We are sending mail with results at report@fotonower.com refus_total : 0.04190112060013058 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=19777203 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1330316864,1330317082,1330316879,1330317076,1330317086,1330316859,1330317079,1330317073,1330317070,1330317036,1330317028,1330317014,1330317011,1330317005,1330317003,1330316882,1330316876,1330316871) Found this number of photos: 18 begin to download photo : 1330316864 begin to download photo : 1330317086 begin to download photo : 1330317070 begin to download photo : 1330317011 begin to download photo : 1330316876 download finish for photo 1330317011 begin to download photo : 1330317005 download finish for photo 1330317070 begin to download photo : 1330317036 download finish for photo 1330316864 begin to download photo : 1330317082 download finish for photo 1330316876 begin to download photo : 1330316871 download finish for photo 1330317086 begin to download photo : 1330316859 download finish for photo 1330317005 begin to download photo : 1330317003 download finish for photo 1330317082 begin to download photo : 1330316879 download finish for photo 1330317036 begin to download photo : 1330317028 download finish for photo 1330316871 download finish for photo 1330316859 begin to download photo : 1330317079 download finish for photo 1330317003 begin to download photo : 1330316882 download finish for photo 1330317028 begin to download photo : 1330317014 download finish for photo 1330316879 begin to download photo : 1330317076 download finish for photo 1330317079 begin to download photo : 1330317073 download finish for photo 1330316882 download finish for photo 1330317076 download finish for photo 1330317014 download finish for photo 1330317073 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777203_01-02-2025_02_10_46.pdf results_Auto_P19777203_01-02-2025_02_10_46.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777203_01-02-2025_02_10_46.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4909','19777203','results_Auto_P19777203_01-02-2025_02_10_46.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777203_01-02-2025_02_10_46.pdf','pdf','','0.43','0.04190112060013058') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1330317086, 1330317082, 1330317079, 1330317076, 1330317073, 1330317070, 1330317036, 1330317028, 1330317014, 1330317011] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317086', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317082', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317079', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317076', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317073', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317070', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317036', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317028', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317014', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317011', None, None, None, None, None, '2533520') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.1815650463104248 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.244954109191895 time spend to save output : 0.18186211585998535 total time spend for step 13 : 8.42681622505188 step14:split_time_score Sat Feb 1 02:10:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('22', 18),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 20012025 19777203 Nombre de photos uploadées : 18 / 23040 (0%) 20012025 19777203 Nombre de photos taguées (types de déchets): 0 / 18 (0%) 20012025 19777203 Nombre de photos taguées (volume) : 0 / 18 (0%) elapsed_time : load_data_split_time_score 3.0994415283203125e-06 elapsed_time : order_list_meta_photo_and_scores 1.1444091796875e-05 ?????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0008568763732910156 elapsed_time : insert_dashboard_record_day_entry 0.02967071533203125 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.05368542655064632 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19756680_20-01-2025_15_42_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19756680 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19756680 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19758113_24-01-2025_03_37_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19758113 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19759715_21-01-2025_11_22_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19759715 order by id desc limit 1 Qualite : 0.06918528095839836 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19759717_20-01-2025_16_35_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19759717 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19759717 AND mptpi.`type`=4207 To do Qualite : 0.15889673840838808 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19760921_21-01-2025_02_16_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19760921 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19760921 AND mptpi.`type`=3327 To do Qualite : 0.06950101375332633 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19760922_20-01-2025_17_21_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19760922 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19760922 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19762317_21-01-2025_13_06_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19762317 order by id desc limit 1 Qualite : 0.12856035913273142 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19762319_21-01-2025_02_30_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19762319 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19762319 AND mptpi.`type`=3327 To do Qualite : 0.050119454659034675 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19764097_20-01-2025_19_04_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19764097 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19764097 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19764099_21-01-2025_14_11_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19764099 order by id desc limit 1 Qualite : 0.0786938007210795 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19764105_20-01-2025_18_54_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19764105 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19764105 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767139_21-01-2025_04_24_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767139 order by id desc limit 1 Qualite : 0.0 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767140_21-01-2025_04_23_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767140 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19767140 AND mptpi.`type`=4209 To do Qualite : 0.06752219012654 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767141_20-01-2025_19_53_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767141 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19767141 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767142_22-01-2025_08_47_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767142 order by id desc limit 1 Qualite : 0.0927947099350885 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767143_21-01-2025_02_39_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767143 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19767143 AND mptpi.`type`=3327 To do Qualite : 0.03400019813689533 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767144_21-01-2025_04_33_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767144 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19767144 AND mptpi.`type`=4205 To do Qualite : 0.06198034924246159 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767145_20-01-2025_19_46_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767145 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19767145 AND mptpi.`type`=4207 To do Qualite : 0.07309230429021216 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19768584_21-01-2025_02_07_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19768584 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19768584 AND mptpi.`type`=3327 To do Qualite : 0.05940739517148176 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19768589_20-01-2025_20_14_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19768589 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19768589 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19770008_21-01-2025_06_04_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19770008 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19770010_22-01-2025_09_13_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19770010 order by id desc limit 1 Qualite : 0.045333373431294996 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19770011_20-01-2025_21_18_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19770011 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19770011 AND mptpi.`type`=4207 To do Qualite : 0.08460401115881525 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19770012_21-01-2025_01_51_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19770012 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19770012 AND mptpi.`type`=3327 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19772060_22-01-2025_09_43_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19772060 order by id desc limit 1 Qualite : 0.05919716841688413 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19772062_20-01-2025_21_46_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19772062 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19772062 AND mptpi.`type`=4207 To do Qualite : 0.05021197427524266 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19773068_22-01-2025_17_53_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19773068 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19773068 AND mptpi.`type`=4203 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19773069_22-01-2025_16_13_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19773069 order by id desc limit 1 Qualite : 0.09343093275297072 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19773070_20-01-2025_23_18_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19773070 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19773070 AND mptpi.`type`=3327 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19773071_21-01-2025_10_35_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19773071 order by id desc limit 1 Qualite : 0.06740297704934484 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19774194_20-01-2025_22_43_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19774194 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19774194 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777200_22-01-2025_18_48_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777200 order by id desc limit 1 Qualite : 0.05421734473668348 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777201_21-01-2025_01_27_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777201 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777201 AND mptpi.`type`=3327 To do Qualite : 0.044092539373829086 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777202_21-01-2025_00_21_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777202 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777202 AND mptpi.`type`=4207 To do Qualite : 0.04190112060013058 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777203_01-02-2025_02_10_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777203 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777203 AND mptpi.`type`=4211 To do Qualite : 0.048840458590288995 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777205_21-01-2025_00_13_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777205 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777205 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777206_24-01-2025_03_16_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777206 order by id desc limit 1 Qualite : 0.09987592641146087 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777207_21-01-2025_00_56_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777207 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777207 AND mptpi.`type`=3327 To do Qualite : 0.0 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777208_21-01-2025_12_02_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777208 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777208 AND mptpi.`type`=4209 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777209_21-01-2025_12_14_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777209 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'20012025': {'nb_upload': 18, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1330317086, 1330317082, 1330317079, 1330317076, 1330317073, 1330317070, 1330317036, 1330317028, 1330317014, 1330317011] Looping around the photos to save general results len do output : 1 /19777203Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317086', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317082', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317079', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317076', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317073', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317070', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317036', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317028', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317014', None, None, None, None, None, '2533520') ('4909', None, None, None, None, None, None, None, '2533520') ('4909', '19777203', '1330317011', None, None, None, None, None, '2533520') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.0175173282623291 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.201362133026123 time spend to save output : 0.017849445343017578 total time spend for step 14 : 8.21921157836914 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 161.96user 52.66system 6:38.56elapsed 53%CPU (0avgtext+0avgdata 4315028maxresident)k 710120inputs+195304outputs (401major+6425256minor)pagefaults 0swaps