python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4909 -l 10 ' -s datou_current_4909 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3255083 load datou : 4909 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? id de la photo (peut être local ou global) was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5359, 'Mask_Limeil_Label_PEHD_080621', 16384, 25088, 'Mask_Limeil_Label_PEHD_080621', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 6, 9, 7, 22, 34), datetime.datetime(2021, 6, 9, 7, 22, 34)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5557, 'learn_generique_01122021_6000_v2', 2048, 2048, 'learn_generique_01122021_6000_v2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 1, 19, 59, 17), datetime.datetime(2021, 12, 1, 19, 59, 17)) load thcls load THCL from format json or kwargs add thcl : 2976 in CacheModelConfig load THCL from format json or kwargs add thcl : 3233 in CacheModelConfig load pdts add pdt : 5359 in CacheModelConfig add pdt : 5557 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 19>10 please execute split_portfolio.py -i 19767139 -l 10 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4909, datou_cur_ids : ['2533516'] with mtr_portfolio_ids : ['19767139'] and first list_photo_ids : [] new path : /proc/3255083/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, blur_detection, brightness, crop_condition, thcl, argmax, merge_mask_thcl_custom, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 1.3936095237731934 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 14 step1:mask_detect Sat Feb 1 05:04:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-01 05:04:31.435846: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-01 05:04:31.463512: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493020000 Hz 2025-02-01 05:04:31.465626: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fa168000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-01 05:04:31.465667: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-01 05:04:31.469449: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-01 05:04:31.719399: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1f7cb680 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-01 05:04:31.719455: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-01 05:04:31.720646: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 05:04:31.721010: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 05:04:31.723226: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 05:04:31.725527: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 05:04:31.725920: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 05:04:31.728718: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 05:04:31.730062: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 05:04:31.735686: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 05:04:31.737380: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 05:04:31.737470: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 05:04:31.738381: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 05:04:31.738402: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 05:04:31.738415: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 05:04:31.740040: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-01 05:04:32.036843: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 05:04:32.036946: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 05:04:32.036965: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 05:04:32.036983: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 05:04:32.036998: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 05:04:32.037012: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 05:04:32.037027: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 05:04:32.037042: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 05:04:32.038403: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 05:04:32.039778: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 05:04:32.039871: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 05:04:32.039891: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 05:04:32.039908: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 05:04:32.039924: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 05:04:32.039941: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 05:04:32.039956: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 05:04:32.039974: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 05:04:32.041454: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 05:04:32.041500: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 05:04:32.041511: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 05:04:32.041520: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 05:04:32.042974: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2976 thcls : [{'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5359 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5359, 'Mask_Limeil_Label_PEHD_080621', 16384, 25088, 'Mask_Limeil_Label_PEHD_080621', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 6, 9, 7, 22, 34), datetime.datetime(2021, 6, 9, 7, 22, 34)) {'thcl': {'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'environnement', 'fibreux_cont', 'metal_cont', 'pet_clair_cont', 'pet_fonce_cont', 'pet_opaque_cont', 'barquette', 'film_plastique', 'autre_contaminant', 'etiquette_detachee'], 'list_hashtags_csv': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'svm_hashtag_type_desc': 5359, 'photo_desc_type': 5359, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'environnement', 'fibreux_cont', 'metal_cont', 'pet_clair_cont', 'pet_fonce_cont', 'pet_opaque_cont', 'barquette', 'film_plastique', 'autre_contaminant', 'etiquette_detachee'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME Mask_Limeil_Label_PEHD_080621 NUM_CLASSES 11 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : Mask_Limeil_Label_PEHD_080621 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-01 05:04:39.395051: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 05:04:39.577775: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/Mask_Limeil_Label_PEHD_080621 /data/models_weight/Mask_Limeil_Label_PEHD_080621/mask_model.h5 size_local : 256052544 size in s3 : 256052544 create time local : 2021-08-11 19:43:15 create time in s3 : 2021-08-06 17:21:30 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 73 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 74 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 76 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 70 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 43 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 61 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 55 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 77 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 19) min: 0.00000 max: 1920.00000 nb d'objets trouves : 53 Detection mask done ! Trying to reset tf kernel 3255571 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5485 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10774 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2976 Catched exception ! Connect or reconnect ! thcls : [{'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2976, 'mtr_user_id': 31, 'name': 'Mask_Limeil_Label_PEHD_080621', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,environnement,fibreux_cont,metal_cont,pet_clair_cont,pet_fonce_cont,pet_opaque_cont,barquette,film_plastique,autre_contaminant,etiquette_detachee', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3760, 'photo_desc_type': 5359, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5359 ['background', 'environnement', 'fibreux_cont', 'metal_cont', 'pet_clair_cont', 'pet_fonce_cont', 'pet_opaque_cont', 'barquette', 'film_plastique', 'autre_contaminant', 'etiquette_detachee'] time for calcul the mask position with numpy : 0.0036525726318359375 nb_pixel_total : 105873 time to create 1 rle with old method : 0.11019134521484375 length of segment : 394 time for calcul the mask position with numpy : 0.0027687549591064453 nb_pixel_total : 99195 time to create 1 rle with old method : 0.11778736114501953 length of segment : 493 time for calcul the mask position with numpy : 0.0004444122314453125 nb_pixel_total : 13536 time to create 1 rle with old method : 0.014617681503295898 length of segment : 136 time for calcul the mask position with numpy : 0.0006346702575683594 nb_pixel_total : 10761 time to create 1 rle with old method : 0.01192474365234375 length of segment : 119 time for calcul the mask position with numpy : 0.0021567344665527344 nb_pixel_total : 84093 time to create 1 rle with old method : 0.08801054954528809 length of segment : 408 time for calcul the mask position with numpy : 0.002207040786743164 nb_pixel_total : 89616 time to create 1 rle with old method : 0.0933074951171875 length of segment : 546 time for calcul the mask position with numpy : 0.0001957416534423828 nb_pixel_total : 4735 time to create 1 rle with old method : 0.005278587341308594 length of segment : 65 time for calcul the mask position with numpy : 0.002286672592163086 nb_pixel_total : 90026 time to create 1 rle with old method : 0.09186148643493652 length of segment : 432 time for calcul the mask position with numpy : 0.0003516674041748047 nb_pixel_total : 9980 time to create 1 rle with old method : 0.010944843292236328 length of segment : 147 time for calcul the mask position with numpy : 0.00018835067749023438 nb_pixel_total : 3230 time to create 1 rle with old method : 0.0037686824798583984 length of segment : 55 time for calcul the mask position with numpy : 0.00012731552124023438 nb_pixel_total : 2212 time to create 1 rle with old method : 0.002619028091430664 length of segment : 51 time for calcul the mask position with numpy : 0.0003006458282470703 nb_pixel_total : 9023 time to create 1 rle with old method : 0.009811878204345703 length of segment : 102 time for calcul the mask position with numpy : 8.273124694824219e-05 nb_pixel_total : 1222 time to create 1 rle with old method : 0.0015149116516113281 length of segment : 47 time for calcul the mask position with numpy : 0.0006825923919677734 nb_pixel_total : 22811 time to create 1 rle with old method : 0.02540302276611328 length of segment : 168 time for calcul the mask position with numpy : 0.00022721290588378906 nb_pixel_total : 2442 time to create 1 rle with old method : 0.0028383731842041016 length of segment : 78 time for calcul the mask position with numpy : 0.0003299713134765625 nb_pixel_total : 7758 time to create 1 rle with old method : 0.008740663528442383 length of segment : 165 time for calcul the mask position with numpy : 0.0002162456512451172 nb_pixel_total : 5147 time to create 1 rle with old method : 0.006026744842529297 length of segment : 77 time for calcul the mask position with numpy : 0.00023365020751953125 nb_pixel_total : 4142 time to create 1 rle with old method : 0.0049512386322021484 length of segment : 55 time for calcul the mask position with numpy : 0.00012040138244628906 nb_pixel_total : 2583 time to create 1 rle with old method : 0.003042459487915039 length of segment : 67 time for calcul the mask position with numpy : 0.0001304149627685547 nb_pixel_total : 2969 time to create 1 rle with old method : 0.0035665035247802734 length of segment : 64 time for calcul the mask position with numpy : 0.0014498233795166016 nb_pixel_total : 43157 time to create 1 rle with old method : 0.04620003700256348 length of segment : 215 time for calcul the mask position with numpy : 0.0002498626708984375 nb_pixel_total : 5755 time to create 1 rle with old method : 0.0061070919036865234 length of segment : 145 time for calcul the mask position with numpy : 0.0001633167266845703 nb_pixel_total : 4132 time to create 1 rle with old method : 0.004424095153808594 length of segment : 60 time for calcul the mask position with numpy : 0.00024247169494628906 nb_pixel_total : 5981 time to create 1 rle with old method : 0.006923675537109375 length of segment : 73 time for calcul the mask position with numpy : 0.00018978118896484375 nb_pixel_total : 5088 time to create 1 rle with old method : 0.0055866241455078125 length of segment : 78 time for calcul the mask position with numpy : 0.00039124488830566406 nb_pixel_total : 9087 time to create 1 rle with old method : 0.010124683380126953 length of segment : 203 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 1088 time to create 1 rle with old method : 0.0012133121490478516 length of segment : 80 time for calcul the mask position with numpy : 0.00014543533325195312 nb_pixel_total : 3690 time to create 1 rle with old method : 0.004019260406494141 length of segment : 74 time for calcul the mask position with numpy : 0.0001842975616455078 nb_pixel_total : 4701 time to create 1 rle with old method : 0.0051116943359375 length of segment : 115 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 1583 time to create 1 rle with old method : 0.0019440650939941406 length of segment : 41 time for calcul the mask position with numpy : 0.00010251998901367188 nb_pixel_total : 2326 time to create 1 rle with old method : 0.002825498580932617 length of segment : 48 time for calcul the mask position with numpy : 0.0004830360412597656 nb_pixel_total : 17046 time to create 1 rle with old method : 0.01800370216369629 length of segment : 164 time for calcul the mask position with numpy : 0.0023174285888671875 nb_pixel_total : 59145 time to create 1 rle with old method : 0.06467151641845703 length of segment : 336 time for calcul the mask position with numpy : 0.0003056526184082031 nb_pixel_total : 7144 time to create 1 rle with old method : 0.008407354354858398 length of segment : 131 time for calcul the mask position with numpy : 0.002387523651123047 nb_pixel_total : 102641 time to create 1 rle with old method : 0.10785460472106934 length of segment : 377 time for calcul the mask position with numpy : 0.002614259719848633 nb_pixel_total : 87241 time to create 1 rle with old method : 0.09401249885559082 length of segment : 408 time for calcul the mask position with numpy : 0.0022711753845214844 nb_pixel_total : 98056 time to create 1 rle with old method : 0.10315608978271484 length of segment : 415 time for calcul the mask position with numpy : 0.003713369369506836 nb_pixel_total : 114222 time to create 1 rle with old method : 0.11528682708740234 length of segment : 542 time for calcul the mask position with numpy : 0.0023660659790039062 nb_pixel_total : 95634 time to create 1 rle with old method : 0.09977364540100098 length of segment : 435 time for calcul the mask position with numpy : 0.00440526008605957 nb_pixel_total : 141150 time to create 1 rle with old method : 0.14420104026794434 length of segment : 482 time for calcul the mask position with numpy : 0.0005106925964355469 nb_pixel_total : 18597 time to create 1 rle with old method : 0.020454883575439453 length of segment : 160 time for calcul the mask position with numpy : 0.0003571510314941406 nb_pixel_total : 8954 time to create 1 rle with old method : 0.009641408920288086 length of segment : 161 time for calcul the mask position with numpy : 0.0011305809020996094 nb_pixel_total : 35483 time to create 1 rle with old method : 0.03668785095214844 length of segment : 252 time for calcul the mask position with numpy : 0.0003376007080078125 nb_pixel_total : 7881 time to create 1 rle with old method : 0.008588552474975586 length of segment : 173 time for calcul the mask position with numpy : 9.131431579589844e-05 nb_pixel_total : 986 time to create 1 rle with old method : 0.0011293888092041016 length of segment : 63 time for calcul the mask position with numpy : 0.00023698806762695312 nb_pixel_total : 6738 time to create 1 rle with old method : 0.007486581802368164 length of segment : 111 time for calcul the mask position with numpy : 0.000213623046875 nb_pixel_total : 8006 time to create 1 rle with old method : 0.009210348129272461 length of segment : 72 time for calcul the mask position with numpy : 0.000286102294921875 nb_pixel_total : 10517 time to create 1 rle with old method : 0.011439800262451172 length of segment : 97 time for calcul the mask position with numpy : 0.0001544952392578125 nb_pixel_total : 4527 time to create 1 rle with old method : 0.004720926284790039 length of segment : 121 time for calcul the mask position with numpy : 0.0001609325408935547 nb_pixel_total : 4683 time to create 1 rle with old method : 0.0049915313720703125 length of segment : 115 time for calcul the mask position with numpy : 7.677078247070312e-05 nb_pixel_total : 1037 time to create 1 rle with old method : 0.0011379718780517578 length of segment : 53 time for calcul the mask position with numpy : 0.0001704692840576172 nb_pixel_total : 3197 time to create 1 rle with old method : 0.0034477710723876953 length of segment : 74 time for calcul the mask position with numpy : 0.0005125999450683594 nb_pixel_total : 13451 time to create 1 rle with old method : 0.014707565307617188 length of segment : 205 time for calcul the mask position with numpy : 0.0005676746368408203 nb_pixel_total : 10058 time to create 1 rle with old method : 0.010564565658569336 length of segment : 206 time for calcul the mask position with numpy : 0.0005238056182861328 nb_pixel_total : 14194 time to create 1 rle with old method : 0.015565633773803711 length of segment : 173 time for calcul the mask position with numpy : 0.0003254413604736328 nb_pixel_total : 9381 time to create 1 rle with old method : 0.00983881950378418 length of segment : 134 time for calcul the mask position with numpy : 0.0004634857177734375 nb_pixel_total : 12672 time to create 1 rle with old method : 0.013208627700805664 length of segment : 202 time for calcul the mask position with numpy : 0.0006384849548339844 nb_pixel_total : 23382 time to create 1 rle with old method : 0.025707483291625977 length of segment : 251 time for calcul the mask position with numpy : 0.0002391338348388672 nb_pixel_total : 7680 time to create 1 rle with old method : 0.008033037185668945 length of segment : 203 time for calcul the mask position with numpy : 0.00015044212341308594 nb_pixel_total : 5436 time to create 1 rle with old method : 0.005735635757446289 length of segment : 86 time for calcul the mask position with numpy : 0.0003333091735839844 nb_pixel_total : 12826 time to create 1 rle with old method : 0.01435399055480957 length of segment : 148 time for calcul the mask position with numpy : 0.0019979476928710938 nb_pixel_total : 107090 time to create 1 rle with old method : 0.12750697135925293 length of segment : 377 time for calcul the mask position with numpy : 0.0021398067474365234 nb_pixel_total : 111959 time to create 1 rle with old method : 0.12296199798583984 length of segment : 433 time for calcul the mask position with numpy : 0.002527952194213867 nb_pixel_total : 110995 time to create 1 rle with old method : 0.1192164421081543 length of segment : 388 time for calcul the mask position with numpy : 0.0019919872283935547 nb_pixel_total : 115333 time to create 1 rle with old method : 0.13413190841674805 length of segment : 440 time for calcul the mask position with numpy : 0.0001327991485595703 nb_pixel_total : 1619 time to create 1 rle with old method : 0.0018985271453857422 length of segment : 67 time for calcul the mask position with numpy : 0.0011212825775146484 nb_pixel_total : 20915 time to create 1 rle with old method : 0.023935317993164062 length of segment : 158 time for calcul the mask position with numpy : 0.0008993148803710938 nb_pixel_total : 9969 time to create 1 rle with old method : 0.011778831481933594 length of segment : 160 time for calcul the mask position with numpy : 0.00408935546875 nb_pixel_total : 73954 time to create 1 rle with old method : 0.07949161529541016 length of segment : 440 time for calcul the mask position with numpy : 0.0032956600189208984 nb_pixel_total : 92858 time to create 1 rle with old method : 0.09573578834533691 length of segment : 492 time for calcul the mask position with numpy : 0.0003552436828613281 nb_pixel_total : 1391 time to create 1 rle with old method : 0.0018107891082763672 length of segment : 64 time for calcul the mask position with numpy : 0.0005340576171875 nb_pixel_total : 8815 time to create 1 rle with old method : 0.009691953659057617 length of segment : 132 time for calcul the mask position with numpy : 0.0009551048278808594 nb_pixel_total : 12662 time to create 1 rle with old method : 0.013672351837158203 length of segment : 141 time for calcul the mask position with numpy : 0.00027370452880859375 nb_pixel_total : 2466 time to create 1 rle with old method : 0.002777576446533203 length of segment : 89 time for calcul the mask position with numpy : 0.0004215240478515625 nb_pixel_total : 4079 time to create 1 rle with old method : 0.0045778751373291016 length of segment : 89 time for calcul the mask position with numpy : 0.0004911422729492188 nb_pixel_total : 7830 time to create 1 rle with old method : 0.008854866027832031 length of segment : 76 time for calcul the mask position with numpy : 0.0013039112091064453 nb_pixel_total : 18448 time to create 1 rle with old method : 0.020058393478393555 length of segment : 181 time for calcul the mask position with numpy : 0.0008080005645751953 nb_pixel_total : 9546 time to create 1 rle with old method : 0.010358810424804688 length of segment : 152 time for calcul the mask position with numpy : 0.0016360282897949219 nb_pixel_total : 24418 time to create 1 rle with old method : 0.026115894317626953 length of segment : 171 time for calcul the mask position with numpy : 0.000946044921875 nb_pixel_total : 15384 time to create 1 rle with old method : 0.016564607620239258 length of segment : 176 time for calcul the mask position with numpy : 0.0016713142395019531 nb_pixel_total : 17974 time to create 1 rle with old method : 0.018848419189453125 length of segment : 222 time for calcul the mask position with numpy : 0.00012373924255371094 nb_pixel_total : 689 time to create 1 rle with old method : 0.0008399486541748047 length of segment : 52 time for calcul the mask position with numpy : 0.0010428428649902344 nb_pixel_total : 9810 time to create 1 rle with old method : 0.010271787643432617 length of segment : 144 time for calcul the mask position with numpy : 0.0004792213439941406 nb_pixel_total : 3809 time to create 1 rle with old method : 0.004388570785522461 length of segment : 117 time for calcul the mask position with numpy : 0.0021414756774902344 nb_pixel_total : 32765 time to create 1 rle with old method : 0.03501582145690918 length of segment : 258 time for calcul the mask position with numpy : 9.965896606445312e-05 nb_pixel_total : 489 time to create 1 rle with old method : 0.0005533695220947266 length of segment : 33 time for calcul the mask position with numpy : 0.00029397010803222656 nb_pixel_total : 3548 time to create 1 rle with old method : 0.004332065582275391 length of segment : 40 time for calcul the mask position with numpy : 0.00023436546325683594 nb_pixel_total : 2980 time to create 1 rle with old method : 0.0034341812133789062 length of segment : 132 time for calcul the mask position with numpy : 0.00033926963806152344 nb_pixel_total : 7200 time to create 1 rle with old method : 0.007913351058959961 length of segment : 125 time for calcul the mask position with numpy : 0.0003952980041503906 nb_pixel_total : 10394 time to create 1 rle with old method : 0.011175155639648438 length of segment : 184 time for calcul the mask position with numpy : 0.00041675567626953125 nb_pixel_total : 5549 time to create 1 rle with old method : 0.006252765655517578 length of segment : 165 time for calcul the mask position with numpy : 0.000209808349609375 nb_pixel_total : 3132 time to create 1 rle with old method : 0.0035965442657470703 length of segment : 44 time for calcul the mask position with numpy : 0.0002980232238769531 nb_pixel_total : 5242 time to create 1 rle with old method : 0.0062291622161865234 length of segment : 58 time for calcul the mask position with numpy : 0.0003421306610107422 nb_pixel_total : 5574 time to create 1 rle with old method : 0.0061833858489990234 length of segment : 83 time for calcul the mask position with numpy : 0.0002040863037109375 nb_pixel_total : 4323 time to create 1 rle with old method : 0.005011081695556641 length of segment : 67 time for calcul the mask position with numpy : 0.000102996826171875 nb_pixel_total : 1597 time to create 1 rle with old method : 0.0018901824951171875 length of segment : 49 time for calcul the mask position with numpy : 0.00020003318786621094 nb_pixel_total : 3695 time to create 1 rle with old method : 0.004179239273071289 length of segment : 118 time for calcul the mask position with numpy : 0.0044443607330322266 nb_pixel_total : 83733 time to create 1 rle with old method : 0.08974266052246094 length of segment : 596 time for calcul the mask position with numpy : 0.004214286804199219 nb_pixel_total : 92204 time to create 1 rle with old method : 0.10184049606323242 length of segment : 431 time for calcul the mask position with numpy : 0.0037698745727539062 nb_pixel_total : 92957 time to create 1 rle with old method : 0.10342717170715332 length of segment : 408 time for calcul the mask position with numpy : 0.00020575523376464844 nb_pixel_total : 1925 time to create 1 rle with old method : 0.002429962158203125 length of segment : 41 time for calcul the mask position with numpy : 0.004175662994384766 nb_pixel_total : 94684 time to create 1 rle with old method : 0.10106825828552246 length of segment : 483 time for calcul the mask position with numpy : 0.003629446029663086 nb_pixel_total : 101962 time to create 1 rle with old method : 0.1057286262512207 length of segment : 449 time for calcul the mask position with numpy : 0.00022172927856445312 nb_pixel_total : 3250 time to create 1 rle with old method : 0.003934621810913086 length of segment : 53 time for calcul the mask position with numpy : 0.003178119659423828 nb_pixel_total : 107344 time to create 1 rle with old method : 0.12042880058288574 length of segment : 555 time for calcul the mask position with numpy : 0.002730846405029297 nb_pixel_total : 52134 time to create 1 rle with old method : 0.05933094024658203 length of segment : 332 time for calcul the mask position with numpy : 0.0005762577056884766 nb_pixel_total : 11358 time to create 1 rle with old method : 0.012772560119628906 length of segment : 128 time for calcul the mask position with numpy : 0.0019228458404541016 nb_pixel_total : 27026 time to create 1 rle with old method : 0.028836727142333984 length of segment : 233 time for calcul the mask position with numpy : 0.00037097930908203125 nb_pixel_total : 5347 time to create 1 rle with old method : 0.006230592727661133 length of segment : 82 time for calcul the mask position with numpy : 0.0008509159088134766 nb_pixel_total : 16872 time to create 1 rle with old method : 0.017982006072998047 length of segment : 162 time for calcul the mask position with numpy : 0.0008873939514160156 nb_pixel_total : 13417 time to create 1 rle with old method : 0.013758182525634766 length of segment : 172 time for calcul the mask position with numpy : 0.001102447509765625 nb_pixel_total : 23849 time to create 1 rle with old method : 0.02525019645690918 length of segment : 113 time for calcul the mask position with numpy : 0.0004837512969970703 nb_pixel_total : 8322 time to create 1 rle with old method : 0.008503437042236328 length of segment : 120 time for calcul the mask position with numpy : 0.0005829334259033203 nb_pixel_total : 7953 time to create 1 rle with old method : 0.008668184280395508 length of segment : 112 time for calcul the mask position with numpy : 0.0005681514739990234 nb_pixel_total : 4792 time to create 1 rle with old method : 0.0052835941314697266 length of segment : 131 time for calcul the mask position with numpy : 0.00022363662719726562 nb_pixel_total : 6383 time to create 1 rle with old method : 0.007046222686767578 length of segment : 97 time for calcul the mask position with numpy : 0.0002732276916503906 nb_pixel_total : 4857 time to create 1 rle with old method : 0.00533294677734375 length of segment : 76 time for calcul the mask position with numpy : 0.00023293495178222656 nb_pixel_total : 4388 time to create 1 rle with old method : 0.004752635955810547 length of segment : 114 time for calcul the mask position with numpy : 0.0005295276641845703 nb_pixel_total : 12742 time to create 1 rle with old method : 0.014448165893554688 length of segment : 135 time for calcul the mask position with numpy : 0.0011737346649169922 nb_pixel_total : 20966 time to create 1 rle with old method : 0.02169013023376465 length of segment : 172 time for calcul the mask position with numpy : 0.00041961669921875 nb_pixel_total : 7891 time to create 1 rle with old method : 0.00940084457397461 length of segment : 137 time for calcul the mask position with numpy : 0.0003960132598876953 nb_pixel_total : 4508 time to create 1 rle with old method : 0.004921913146972656 length of segment : 138 time for calcul the mask position with numpy : 0.0006401538848876953 nb_pixel_total : 9113 time to create 1 rle with old method : 0.010165691375732422 length of segment : 160 time for calcul the mask position with numpy : 0.000339508056640625 nb_pixel_total : 5236 time to create 1 rle with old method : 0.005780458450317383 length of segment : 94 time for calcul the mask position with numpy : 0.0002815723419189453 nb_pixel_total : 4749 time to create 1 rle with old method : 0.005475521087646484 length of segment : 83 time for calcul the mask position with numpy : 0.0001087188720703125 nb_pixel_total : 3708 time to create 1 rle with old method : 0.004082441329956055 length of segment : 92 time for calcul the mask position with numpy : 0.0006475448608398438 nb_pixel_total : 8712 time to create 1 rle with old method : 0.009524822235107422 length of segment : 120 time for calcul the mask position with numpy : 0.0002582073211669922 nb_pixel_total : 3205 time to create 1 rle with old method : 0.0035054683685302734 length of segment : 60 time for calcul the mask position with numpy : 0.0006721019744873047 nb_pixel_total : 12301 time to create 1 rle with old method : 0.013054370880126953 length of segment : 144 time for calcul the mask position with numpy : 0.0001747608184814453 nb_pixel_total : 2235 time to create 1 rle with old method : 0.002647876739501953 length of segment : 63 time for calcul the mask position with numpy : 0.00029587745666503906 nb_pixel_total : 3272 time to create 1 rle with old method : 0.0038683414459228516 length of segment : 74 time for calcul the mask position with numpy : 0.000518798828125 nb_pixel_total : 21066 time to create 1 rle with old method : 0.021457433700561523 length of segment : 172 time for calcul the mask position with numpy : 0.00046539306640625 nb_pixel_total : 5474 time to create 1 rle with old method : 0.006043434143066406 length of segment : 145 time for calcul the mask position with numpy : 0.00030732154846191406 nb_pixel_total : 16669 time to create 1 rle with old method : 0.017498254776000977 length of segment : 153 time for calcul the mask position with numpy : 0.001129150390625 nb_pixel_total : 19613 time to create 1 rle with old method : 0.02161383628845215 length of segment : 151 time for calcul the mask position with numpy : 0.00036907196044921875 nb_pixel_total : 6897 time to create 1 rle with old method : 0.007467985153198242 length of segment : 96 time for calcul the mask position with numpy : 0.0030584335327148438 nb_pixel_total : 95527 time to create 1 rle with old method : 0.12508654594421387 length of segment : 319 time for calcul the mask position with numpy : 0.00410008430480957 nb_pixel_total : 116345 time to create 1 rle with old method : 0.1180582046508789 length of segment : 470 time for calcul the mask position with numpy : 0.0029523372650146484 nb_pixel_total : 89600 time to create 1 rle with old method : 0.09973740577697754 length of segment : 391 time for calcul the mask position with numpy : 0.0026772022247314453 nb_pixel_total : 99836 time to create 1 rle with old method : 0.09907364845275879 length of segment : 390 time for calcul the mask position with numpy : 0.003200531005859375 nb_pixel_total : 29841 time to create 1 rle with old method : 0.03531932830810547 length of segment : 258 time for calcul the mask position with numpy : 0.0029234886169433594 nb_pixel_total : 119470 time to create 1 rle with old method : 0.13447165489196777 length of segment : 367 time for calcul the mask position with numpy : 0.002683877944946289 nb_pixel_total : 109978 time to create 1 rle with old method : 0.11667799949645996 length of segment : 477 time for calcul the mask position with numpy : 0.0005049705505371094 nb_pixel_total : 6703 time to create 1 rle with old method : 0.007498741149902344 length of segment : 115 time for calcul the mask position with numpy : 0.0028638839721679688 nb_pixel_total : 102743 time to create 1 rle with old method : 0.10530376434326172 length of segment : 417 time for calcul the mask position with numpy : 0.00043463706970214844 nb_pixel_total : 9353 time to create 1 rle with old method : 0.010871171951293945 length of segment : 86 time for calcul the mask position with numpy : 0.0007219314575195312 nb_pixel_total : 24094 time to create 1 rle with old method : 0.027556896209716797 length of segment : 163 time for calcul the mask position with numpy : 0.0035295486450195312 nb_pixel_total : 115203 time to create 1 rle with old method : 0.13315176963806152 length of segment : 316 time for calcul the mask position with numpy : 0.0025026798248291016 nb_pixel_total : 62393 time to create 1 rle with old method : 0.07069802284240723 length of segment : 443 time for calcul the mask position with numpy : 0.0008618831634521484 nb_pixel_total : 22500 time to create 1 rle with old method : 0.027322769165039062 length of segment : 180 time for calcul the mask position with numpy : 8.7738037109375e-05 nb_pixel_total : 2647 time to create 1 rle with old method : 0.0030755996704101562 length of segment : 56 time for calcul the mask position with numpy : 0.0016946792602539062 nb_pixel_total : 82823 time to create 1 rle with old method : 0.09834480285644531 length of segment : 407 time for calcul the mask position with numpy : 0.002305269241333008 nb_pixel_total : 91905 time to create 1 rle with old method : 0.09507298469543457 length of segment : 358 time for calcul the mask position with numpy : 0.0006170272827148438 nb_pixel_total : 17911 time to create 1 rle with old method : 0.019128084182739258 length of segment : 218 time for calcul the mask position with numpy : 0.0004525184631347656 nb_pixel_total : 13526 time to create 1 rle with old method : 0.014350175857543945 length of segment : 138 time for calcul the mask position with numpy : 0.00028896331787109375 nb_pixel_total : 12309 time to create 1 rle with old method : 0.013567686080932617 length of segment : 128 time for calcul the mask position with numpy : 0.00020813941955566406 nb_pixel_total : 11504 time to create 1 rle with old method : 0.013082027435302734 length of segment : 86 time for calcul the mask position with numpy : 0.000186920166015625 nb_pixel_total : 7836 time to create 1 rle with old method : 0.008455514907836914 length of segment : 129 time for calcul the mask position with numpy : 0.0016057491302490234 nb_pixel_total : 79096 time to create 1 rle with old method : 0.08447599411010742 length of segment : 505 time for calcul the mask position with numpy : 0.00028443336486816406 nb_pixel_total : 7600 time to create 1 rle with old method : 0.008568048477172852 length of segment : 130 time for calcul the mask position with numpy : 0.00017118453979492188 nb_pixel_total : 6527 time to create 1 rle with old method : 0.0075376033782958984 length of segment : 125 time for calcul the mask position with numpy : 0.00015163421630859375 nb_pixel_total : 7679 time to create 1 rle with old method : 0.00866556167602539 length of segment : 103 time for calcul the mask position with numpy : 0.004451274871826172 nb_pixel_total : 97133 time to create 1 rle with old method : 0.1027076244354248 length of segment : 486 time for calcul the mask position with numpy : 0.0041539669036865234 nb_pixel_total : 100277 time to create 1 rle with old method : 0.10861515998840332 length of segment : 396 time for calcul the mask position with numpy : 0.0036902427673339844 nb_pixel_total : 116328 time to create 1 rle with old method : 0.12711310386657715 length of segment : 346 time for calcul the mask position with numpy : 0.0003941059112548828 nb_pixel_total : 6004 time to create 1 rle with old method : 0.006772041320800781 length of segment : 117 time for calcul the mask position with numpy : 0.0004057884216308594 nb_pixel_total : 8914 time to create 1 rle with old method : 0.00980067253112793 length of segment : 95 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 522 time to create 1 rle with old method : 0.0006628036499023438 length of segment : 32 time for calcul the mask position with numpy : 0.0003693103790283203 nb_pixel_total : 6612 time to create 1 rle with old method : 0.007781505584716797 length of segment : 89 time for calcul the mask position with numpy : 0.002447843551635742 nb_pixel_total : 44947 time to create 1 rle with old method : 0.04858851432800293 length of segment : 271 time for calcul the mask position with numpy : 0.0031790733337402344 nb_pixel_total : 132980 time to create 1 rle with old method : 0.1417250633239746 length of segment : 592 time for calcul the mask position with numpy : 0.0005586147308349609 nb_pixel_total : 11538 time to create 1 rle with old method : 0.012680292129516602 length of segment : 142 time for calcul the mask position with numpy : 0.0006322860717773438 nb_pixel_total : 15699 time to create 1 rle with old method : 0.017476797103881836 length of segment : 151 time for calcul the mask position with numpy : 0.0008718967437744141 nb_pixel_total : 17097 time to create 1 rle with old method : 0.018581151962280273 length of segment : 205 time for calcul the mask position with numpy : 0.0002071857452392578 nb_pixel_total : 8979 time to create 1 rle with old method : 0.00990915298461914 length of segment : 119 time for calcul the mask position with numpy : 0.0005826950073242188 nb_pixel_total : 14122 time to create 1 rle with old method : 0.01502227783203125 length of segment : 150 time for calcul the mask position with numpy : 0.002048492431640625 nb_pixel_total : 58829 time to create 1 rle with old method : 0.06120181083679199 length of segment : 485 time for calcul the mask position with numpy : 0.00077056884765625 nb_pixel_total : 12170 time to create 1 rle with old method : 0.012714147567749023 length of segment : 156 time for calcul the mask position with numpy : 0.00018739700317382812 nb_pixel_total : 4806 time to create 1 rle with old method : 0.005106449127197266 length of segment : 98 time for calcul the mask position with numpy : 0.00022411346435546875 nb_pixel_total : 7395 time to create 1 rle with old method : 0.007641315460205078 length of segment : 126 time for calcul the mask position with numpy : 0.0006964206695556641 nb_pixel_total : 25251 time to create 1 rle with old method : 0.028734207153320312 length of segment : 202 time for calcul the mask position with numpy : 0.0002739429473876953 nb_pixel_total : 4040 time to create 1 rle with old method : 0.00474858283996582 length of segment : 87 time for calcul the mask position with numpy : 0.000194549560546875 nb_pixel_total : 3783 time to create 1 rle with old method : 0.0042874813079833984 length of segment : 60 time for calcul the mask position with numpy : 0.0018458366394042969 nb_pixel_total : 94632 time to create 1 rle with old method : 0.10325098037719727 length of segment : 522 time for calcul the mask position with numpy : 7.939338684082031e-05 nb_pixel_total : 1238 time to create 1 rle with old method : 0.0015933513641357422 length of segment : 25 time for calcul the mask position with numpy : 0.0002105236053466797 nb_pixel_total : 5452 time to create 1 rle with old method : 0.0061414241790771484 length of segment : 74 time for calcul the mask position with numpy : 0.0003116130828857422 nb_pixel_total : 6044 time to create 1 rle with old method : 0.006411552429199219 length of segment : 127 time for calcul the mask position with numpy : 0.0007700920104980469 nb_pixel_total : 13908 time to create 1 rle with old method : 0.01666712760925293 length of segment : 142 time for calcul the mask position with numpy : 0.000453948974609375 nb_pixel_total : 7876 time to create 1 rle with old method : 0.008449077606201172 length of segment : 97 time for calcul the mask position with numpy : 0.002335786819458008 nb_pixel_total : 45338 time to create 1 rle with old method : 0.05044960975646973 length of segment : 227 time for calcul the mask position with numpy : 0.0009520053863525391 nb_pixel_total : 18796 time to create 1 rle with old method : 0.018650054931640625 length of segment : 234 time for calcul the mask position with numpy : 0.00012350082397460938 nb_pixel_total : 3629 time to create 1 rle with old method : 0.0040242671966552734 length of segment : 45 time for calcul the mask position with numpy : 0.00039315223693847656 nb_pixel_total : 9525 time to create 1 rle with old method : 0.009917736053466797 length of segment : 98 time for calcul the mask position with numpy : 0.0004322528839111328 nb_pixel_total : 8675 time to create 1 rle with old method : 0.00919485092163086 length of segment : 101 time for calcul the mask position with numpy : 0.00014781951904296875 nb_pixel_total : 1508 time to create 1 rle with old method : 0.0017707347869873047 length of segment : 47 time for calcul the mask position with numpy : 0.0031881332397460938 nb_pixel_total : 96253 time to create 1 rle with old method : 0.10391688346862793 length of segment : 351 time for calcul the mask position with numpy : 0.003710031509399414 nb_pixel_total : 94001 time to create 1 rle with old method : 0.10287618637084961 length of segment : 397 time for calcul the mask position with numpy : 0.0033288002014160156 nb_pixel_total : 83050 time to create 1 rle with old method : 0.0923614501953125 length of segment : 470 time for calcul the mask position with numpy : 0.002371549606323242 nb_pixel_total : 64279 time to create 1 rle with old method : 0.06726765632629395 length of segment : 558 time for calcul the mask position with numpy : 0.002832651138305664 nb_pixel_total : 83802 time to create 1 rle with old method : 0.0889425277709961 length of segment : 465 time for calcul the mask position with numpy : 0.0003001689910888672 nb_pixel_total : 3580 time to create 1 rle with old method : 0.003741741180419922 length of segment : 95 time for calcul the mask position with numpy : 0.0009760856628417969 nb_pixel_total : 22347 time to create 1 rle with old method : 0.02414727210998535 length of segment : 190 time for calcul the mask position with numpy : 0.0005617141723632812 nb_pixel_total : 26220 time to create 1 rle with old method : 0.026690244674682617 length of segment : 216 time for calcul the mask position with numpy : 0.00334930419921875 nb_pixel_total : 105035 time to create 1 rle with old method : 0.10880470275878906 length of segment : 517 time for calcul the mask position with numpy : 9.965896606445312e-05 nb_pixel_total : 627 time to create 1 rle with old method : 0.0007958412170410156 length of segment : 37 time for calcul the mask position with numpy : 0.0002346038818359375 nb_pixel_total : 8562 time to create 1 rle with old method : 0.009999275207519531 length of segment : 117 time for calcul the mask position with numpy : 0.0007090568542480469 nb_pixel_total : 15623 time to create 1 rle with old method : 0.01670670509338379 length of segment : 152 time for calcul the mask position with numpy : 0.0006864070892333984 nb_pixel_total : 11371 time to create 1 rle with old method : 0.01271963119506836 length of segment : 121 time for calcul the mask position with numpy : 0.0004661083221435547 nb_pixel_total : 6984 time to create 1 rle with old method : 0.008401632308959961 length of segment : 117 time for calcul the mask position with numpy : 0.0005517005920410156 nb_pixel_total : 9911 time to create 1 rle with old method : 0.010792970657348633 length of segment : 104 time for calcul the mask position with numpy : 0.00040602684020996094 nb_pixel_total : 12552 time to create 1 rle with old method : 0.013306140899658203 length of segment : 185 time for calcul the mask position with numpy : 0.0004367828369140625 nb_pixel_total : 9431 time to create 1 rle with old method : 0.009691476821899414 length of segment : 169 time for calcul the mask position with numpy : 0.0005996227264404297 nb_pixel_total : 9886 time to create 1 rle with old method : 0.010341405868530273 length of segment : 174 time for calcul the mask position with numpy : 0.0001659393310546875 nb_pixel_total : 7717 time to create 1 rle with old method : 0.008375167846679688 length of segment : 85 time for calcul the mask position with numpy : 0.00043082237243652344 nb_pixel_total : 7397 time to create 1 rle with old method : 0.007845640182495117 length of segment : 94 time for calcul the mask position with numpy : 0.00024437904357910156 nb_pixel_total : 3766 time to create 1 rle with old method : 0.004170894622802734 length of segment : 67 time for calcul the mask position with numpy : 0.00012087821960449219 nb_pixel_total : 4523 time to create 1 rle with old method : 0.0050199031829833984 length of segment : 74 time for calcul the mask position with numpy : 0.0003666877746582031 nb_pixel_total : 11912 time to create 1 rle with old method : 0.013002157211303711 length of segment : 109 time for calcul the mask position with numpy : 0.0022280216217041016 nb_pixel_total : 54317 time to create 1 rle with old method : 0.05711531639099121 length of segment : 656 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 891 time to create 1 rle with old method : 0.0011038780212402344 length of segment : 35 time for calcul the mask position with numpy : 0.0005033016204833984 nb_pixel_total : 8367 time to create 1 rle with old method : 0.008779764175415039 length of segment : 160 time for calcul the mask position with numpy : 0.0032281875610351562 nb_pixel_total : 72850 time to create 1 rle with old method : 0.07533955574035645 length of segment : 415 time for calcul the mask position with numpy : 0.001641988754272461 nb_pixel_total : 31258 time to create 1 rle with old method : 0.03429722785949707 length of segment : 248 time for calcul the mask position with numpy : 0.003232717514038086 nb_pixel_total : 95424 time to create 1 rle with old method : 0.10663604736328125 length of segment : 424 time for calcul the mask position with numpy : 0.003472566604614258 nb_pixel_total : 77756 time to create 1 rle with old method : 0.10302209854125977 length of segment : 411 time for calcul the mask position with numpy : 0.00012564659118652344 nb_pixel_total : 1102 time to create 1 rle with old method : 0.0013964176177978516 length of segment : 32 time for calcul the mask position with numpy : 0.003122568130493164 nb_pixel_total : 67686 time to create 1 rle with old method : 0.07491803169250488 length of segment : 412 time for calcul the mask position with numpy : 9.036064147949219e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0005435943603515625 length of segment : 25 time for calcul the mask position with numpy : 0.0014257431030273438 nb_pixel_total : 20899 time to create 1 rle with old method : 0.02282857894897461 length of segment : 167 time for calcul the mask position with numpy : 0.002906322479248047 nb_pixel_total : 92237 time to create 1 rle with old method : 0.09444689750671387 length of segment : 561 time for calcul the mask position with numpy : 0.0008134841918945312 nb_pixel_total : 16516 time to create 1 rle with old method : 0.017110109329223633 length of segment : 170 time for calcul the mask position with numpy : 0.0009639263153076172 nb_pixel_total : 14907 time to create 1 rle with old method : 0.01601123809814453 length of segment : 152 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 2110 time to create 1 rle with old method : 0.0024292469024658203 length of segment : 83 time for calcul the mask position with numpy : 0.001108407974243164 nb_pixel_total : 23183 time to create 1 rle with old method : 0.024966955184936523 length of segment : 170 time for calcul the mask position with numpy : 0.00020766258239746094 nb_pixel_total : 2305 time to create 1 rle with old method : 0.0028219223022460938 length of segment : 57 time for calcul the mask position with numpy : 0.00015044212341308594 nb_pixel_total : 3422 time to create 1 rle with old method : 0.0042955875396728516 length of segment : 63 time for calcul the mask position with numpy : 0.00036644935607910156 nb_pixel_total : 6469 time to create 1 rle with old method : 0.006901979446411133 length of segment : 111 time for calcul the mask position with numpy : 0.00020432472229003906 nb_pixel_total : 2591 time to create 1 rle with old method : 0.003038167953491211 length of segment : 96 time for calcul the mask position with numpy : 0.0006048679351806641 nb_pixel_total : 12847 time to create 1 rle with old method : 0.01723933219909668 length of segment : 140 time for calcul the mask position with numpy : 0.0008344650268554688 nb_pixel_total : 12426 time to create 1 rle with old method : 0.012986898422241211 length of segment : 120 time for calcul the mask position with numpy : 0.0024673938751220703 nb_pixel_total : 34089 time to create 1 rle with old method : 0.03711414337158203 length of segment : 288 time for calcul the mask position with numpy : 0.001171112060546875 nb_pixel_total : 17306 time to create 1 rle with old method : 0.01922321319580078 length of segment : 183 time for calcul the mask position with numpy : 0.0007309913635253906 nb_pixel_total : 14690 time to create 1 rle with old method : 0.015652894973754883 length of segment : 167 time for calcul the mask position with numpy : 0.0007345676422119141 nb_pixel_total : 14694 time to create 1 rle with old method : 0.015216588973999023 length of segment : 145 time for calcul the mask position with numpy : 0.0019371509552001953 nb_pixel_total : 23015 time to create 1 rle with old method : 0.02371668815612793 length of segment : 218 time for calcul the mask position with numpy : 0.0013742446899414062 nb_pixel_total : 24551 time to create 1 rle with old method : 0.025975465774536133 length of segment : 309 time for calcul the mask position with numpy : 0.0006487369537353516 nb_pixel_total : 12733 time to create 1 rle with old method : 0.01309061050415039 length of segment : 86 time for calcul the mask position with numpy : 0.0001990795135498047 nb_pixel_total : 2624 time to create 1 rle with old method : 0.0029952526092529297 length of segment : 53 time for calcul the mask position with numpy : 0.0015807151794433594 nb_pixel_total : 18503 time to create 1 rle with old method : 0.020590543746948242 length of segment : 231 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 549 time to create 1 rle with old method : 0.0006470680236816406 length of segment : 28 time for calcul the mask position with numpy : 0.0003058910369873047 nb_pixel_total : 6551 time to create 1 rle with old method : 0.007326602935791016 length of segment : 70 time for calcul the mask position with numpy : 0.0008087158203125 nb_pixel_total : 14874 time to create 1 rle with old method : 0.016701459884643555 length of segment : 84 time for calcul the mask position with numpy : 0.0003039836883544922 nb_pixel_total : 6234 time to create 1 rle with old method : 0.007004499435424805 length of segment : 96 time for calcul the mask position with numpy : 0.0017483234405517578 nb_pixel_total : 29826 time to create 1 rle with old method : 0.03292489051818848 length of segment : 258 time for calcul the mask position with numpy : 0.00022482872009277344 nb_pixel_total : 1331 time to create 1 rle with old method : 0.0017333030700683594 length of segment : 57 time for calcul the mask position with numpy : 0.00029969215393066406 nb_pixel_total : 8076 time to create 1 rle with old method : 0.009527444839477539 length of segment : 136 time for calcul the mask position with numpy : 0.00015926361083984375 nb_pixel_total : 922 time to create 1 rle with old method : 0.0012278556823730469 length of segment : 42 time for calcul the mask position with numpy : 0.003712177276611328 nb_pixel_total : 65422 time to create 1 rle with old method : 0.07056069374084473 length of segment : 464 time for calcul the mask position with numpy : 0.0005393028259277344 nb_pixel_total : 17336 time to create 1 rle with old method : 0.01939702033996582 length of segment : 232 time for calcul the mask position with numpy : 0.0002105236053466797 nb_pixel_total : 1733 time to create 1 rle with old method : 0.001988649368286133 length of segment : 53 time for calcul the mask position with numpy : 0.0006022453308105469 nb_pixel_total : 4568 time to create 1 rle with old method : 0.005571126937866211 length of segment : 123 time for calcul the mask position with numpy : 0.0002422332763671875 nb_pixel_total : 5107 time to create 1 rle with old method : 0.005502462387084961 length of segment : 71 time for calcul the mask position with numpy : 0.0002651214599609375 nb_pixel_total : 3129 time to create 1 rle with old method : 0.0033974647521972656 length of segment : 75 time for calcul the mask position with numpy : 0.00012612342834472656 nb_pixel_total : 2689 time to create 1 rle with old method : 0.0028989315032958984 length of segment : 56 time for calcul the mask position with numpy : 0.0015261173248291016 nb_pixel_total : 27273 time to create 1 rle with old method : 0.0283353328704834 length of segment : 285 time for calcul the mask position with numpy : 0.0023851394653320312 nb_pixel_total : 72610 time to create 1 rle with old method : 0.07810258865356445 length of segment : 342 time for calcul the mask position with numpy : 0.0019407272338867188 nb_pixel_total : 47074 time to create 1 rle with old method : 0.04867410659790039 length of segment : 279 time for calcul the mask position with numpy : 0.0037047863006591797 nb_pixel_total : 111265 time to create 1 rle with old method : 0.11570453643798828 length of segment : 399 time for calcul the mask position with numpy : 0.0005879402160644531 nb_pixel_total : 16496 time to create 1 rle with old method : 0.01817798614501953 length of segment : 164 time for calcul the mask position with numpy : 0.003269672393798828 nb_pixel_total : 67550 time to create 1 rle with old method : 0.07491874694824219 length of segment : 503 time for calcul the mask position with numpy : 0.0009052753448486328 nb_pixel_total : 18800 time to create 1 rle with old method : 0.020932435989379883 length of segment : 197 time for calcul the mask position with numpy : 0.0008394718170166016 nb_pixel_total : 16809 time to create 1 rle with old method : 0.017751216888427734 length of segment : 187 time for calcul the mask position with numpy : 0.0024840831756591797 nb_pixel_total : 77521 time to create 1 rle with old method : 0.08131170272827148 length of segment : 414 time for calcul the mask position with numpy : 0.0007753372192382812 nb_pixel_total : 18850 time to create 1 rle with old method : 0.01972031593322754 length of segment : 208 time for calcul the mask position with numpy : 0.0004153251647949219 nb_pixel_total : 8037 time to create 1 rle with old method : 0.008700132369995117 length of segment : 135 time for calcul the mask position with numpy : 0.0017650127410888672 nb_pixel_total : 73418 time to create 1 rle with old method : 0.08130669593811035 length of segment : 493 time for calcul the mask position with numpy : 0.0006430149078369141 nb_pixel_total : 12661 time to create 1 rle with old method : 0.01405787467956543 length of segment : 132 time for calcul the mask position with numpy : 0.00018906593322753906 nb_pixel_total : 4872 time to create 1 rle with old method : 0.005591869354248047 length of segment : 66 time for calcul the mask position with numpy : 0.0006010532379150391 nb_pixel_total : 13188 time to create 1 rle with old method : 0.014782190322875977 length of segment : 109 time for calcul the mask position with numpy : 0.00084686279296875 nb_pixel_total : 14348 time to create 1 rle with old method : 0.017579317092895508 length of segment : 137 time for calcul the mask position with numpy : 9.799003601074219e-05 nb_pixel_total : 2166 time to create 1 rle with old method : 0.0024552345275878906 length of segment : 50 time for calcul the mask position with numpy : 0.00036644935607910156 nb_pixel_total : 5587 time to create 1 rle with old method : 0.0061321258544921875 length of segment : 106 time for calcul the mask position with numpy : 0.000141143798828125 nb_pixel_total : 1910 time to create 1 rle with old method : 0.0022139549255371094 length of segment : 71 time for calcul the mask position with numpy : 0.0007257461547851562 nb_pixel_total : 20161 time to create 1 rle with old method : 0.021298646926879883 length of segment : 177 time for calcul the mask position with numpy : 0.0001316070556640625 nb_pixel_total : 934 time to create 1 rle with old method : 0.0011317729949951172 length of segment : 44 time for calcul the mask position with numpy : 0.00013017654418945312 nb_pixel_total : 3065 time to create 1 rle with old method : 0.0034437179565429688 length of segment : 62 time for calcul the mask position with numpy : 0.0004923343658447266 nb_pixel_total : 9278 time to create 1 rle with old method : 0.009927034378051758 length of segment : 140 time spent for convertir_results : 15.31339168548584 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 330 chid ids of type : 3760 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 55061 save missing photos in datou_result : time spend for datou_step_exec : 52.17120146751404 time spend to save output : 22.92603087425232 total time spend for step 1 : 75.09723234176636 step2:blur_detection Sat Feb 1 05:05:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 9 time used for this insertion : 0.00892186164855957 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 9 time used for this insertion : 0.01221609115600586 save missing photos in datou_result : time spend for datou_step_exec : 0.021439552307128906 time spend to save output : 0.025761842727661133 total time spend for step 2 : 0.04720139503479004 step3:brightness Sat Feb 1 05:05:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 9 time used for this insertion : 0.00878596305847168 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 9 time used for this insertion : 0.009140491485595703 save missing photos in datou_result : time spend for datou_step_exec : 0.025302648544311523 time spend to save output : 0.02264404296875 total time spend for step 3 : 0.04794669151306152 step4:crop_condition Sat Feb 1 05:05:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3760 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 330 chid ids of type : 3760 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : barquette param for this class : {'min_score': 0.7} filtre for class : barquette hashtag_id of this class : 492787675 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 33 About to insert : list_path_to_insert length 33 new photo from crops ! About to upload 33 photos upload in portfolio : 4219792 init cache_photo without model_param we have 33 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738382747_3255083 we have uploaded 33 photos in the portfolio 4219792 time of upload the photos Elapsed time : 10.7921302318573 we have finished the crop for the class : barquette begin to crop the class : fibreux_cont param for this class : {'min_score': 0.7} filtre for class : fibreux_cont hashtag_id of this class : 2107756748 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 4219792 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738382759_3255083 we have uploaded 24 photos in the portfolio 4219792 time of upload the photos Elapsed time : 6.584145545959473 we have finished the crop for the class : fibreux_cont begin to crop the class : film_plastique param for this class : {'min_score': 0.7} filtre for class : film_plastique hashtag_id of this class : 2107756122 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 4219792 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738382766_3255083 we have uploaded 6 photos in the portfolio 4219792 time of upload the photos Elapsed time : 1.7437729835510254 we have finished the crop for the class : film_plastique begin to crop the class : autre_contaminant param for this class : {'min_score': 0.7} filtre for class : autre_contaminant hashtag_id of this class : 2107756781 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 65 About to insert : list_path_to_insert length 65 new photo from crops ! About to upload 65 photos upload in portfolio : 4219792 init cache_photo without model_param we have 65 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738382771_3255083 we have uploaded 65 photos in the portfolio 4219792 time of upload the photos Elapsed time : 20.359050750732422 we have finished the crop for the class : autre_contaminant begin to crop the class : etiquette_detachee param for this class : {'min_score': 0.7} filtre for class : etiquette_detachee hashtag_id of this class : 2107756860 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 4219792 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738382792_3255083 we have uploaded 5 photos in the portfolio 4219792 time of upload the photos Elapsed time : 1.5023698806762695 we have finished the crop for the class : etiquette_detachee begin to crop the class : pet_clair_cont param for this class : {'min_score': 0.7} filtre for class : pet_clair_cont hashtag_id of this class : 2107758154 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 20 About to insert : list_path_to_insert length 20 new photo from crops ! About to upload 20 photos upload in portfolio : 4219792 init cache_photo without model_param we have 20 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738382795_3255083 we have uploaded 20 photos in the portfolio 4219792 time of upload the photos Elapsed time : 5.587773323059082 we have finished the crop for the class : pet_clair_cont begin to crop the class : metal_cont param for this class : {'min_score': 0.7} filtre for class : metal_cont hashtag_id of this class : 2107756749 begin to crop the class : pet_fonce_cont param for this class : {'min_score': 0.7} filtre for class : pet_fonce_cont hashtag_id of this class : 2107758155 begin to crop the class : pet_opaque_cont param for this class : {'min_score': 0.7} filtre for class : pet_opaque_cont hashtag_id of this class : 2107758156 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 42 About to insert : list_path_to_insert length 42 new photo from crops ! About to upload 42 photos upload in portfolio : 4219792 init cache_photo without model_param we have 42 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738382803_3255083 we have uploaded 42 photos in the portfolio 4219792 time of upload the photos Elapsed time : 9.28396725654602 we have finished the crop for the class : pet_opaque_cont delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1330277594, 1330277570, 1330277567, 1330277562, 1330277446, 1330277412, 1330277381, 1330277375, 1330277371] Looping around the photos to save general results len do output : 195 /1333598306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333598782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333599374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277594', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277570', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277567', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277562', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277446', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277412', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277381', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277375', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277371', None, None, None, None, None, '2533516') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 594 time used for this insertion : 0.05250716209411621 save_final save missing photos in datou_result : time spend for datou_step_exec : 69.40513706207275 time spend to save output : 0.05917811393737793 total time spend for step 4 : 69.46431517601013 step5:thcl Sat Feb 1 05:06:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3233 time to import caffe and check if the image exist : 0.01210927963256836 time to convert the images to numpy array : 0.08291506767272949 time to import caffe and check if the image exist : 0.0212857723236084 time to convert the images to numpy array : 0.08501887321472168 time to import caffe and check if the image exist : 0.01099705696105957 time to convert the images to numpy array : 0.09436345100402832 time to import caffe and check if the image exist : 0.01248621940612793 time to convert the images to numpy array : 0.10007405281066895 time to import caffe and check if the image exist : 0.018649578094482422 time to convert the images to numpy array : 0.09512209892272949 time to import caffe and check if the image exist : 0.024626493453979492 time to convert the images to numpy array : 0.09076499938964844 time to import caffe and check if the image exist : 0.008946895599365234 time to convert the images to numpy array : 0.10790562629699707 time to import caffe and check if the image exist : 0.02033066749572754 time to convert the images to numpy array : 0.09739518165588379 time to import caffe and check if the image exist : 0.020252466201782227 time to convert the images to numpy array : 0.0991659164428711 time to import caffe and check if the image exist : 0.013429403305053711 time to convert the images to numpy array : 0.10666131973266602 total time to convert the images to numpy array : 0.4286811351776123 list photo_ids error: [] list photo_ids correct : [1333598615, 1333598620, 1333598624, 1333598629, 1333598633, 1333598637, 1333598642, 1333598646, 1333598651, 1333598655, 1333598660, 1333598664, 1333598668, 1333598671, 1333598675, 1333598680, 1333598684, 1333598761, 1333598765, 1333598769, 1333599190, 1333599191, 1333599192, 1333599193, 1333599194, 1333599195, 1333599196, 1333599197, 1333599198, 1333599199, 1333599200, 1333599201, 1333599202, 1333599203, 1333599204, 1333599205, 1333599207, 1333599208, 1333599209, 1333599210, 1333599356, 1333599357, 1333599359, 1333599360, 1333599361, 1333599362, 1333599363, 1333599364, 1333599365, 1333599366, 1333599367, 1333599368, 1333599370, 1333599372, 1333599374, 1333599307, 1333599308, 1333599309, 1333599310, 1333599311, 1333599312, 1333599313, 1333599314, 1333599315, 1333599316, 1333599317, 1333599318, 1333599319, 1333599329, 1333599330, 1333599331, 1333599332, 1333599333, 1333599334, 1333599335, 1333599211, 1333599212, 1333599213, 1333599214, 1333599215, 1333599216, 1333599217, 1333599218, 1333599219, 1333599220, 1333599221, 1333599222, 1333599223, 1333599224, 1333599225, 1333599226, 1333599227, 1333599228, 1333599229, 1333599230, 1333599231, 1333599234, 1333599239, 1333599242, 1333599245, 1333599249, 1333599252, 1333599255, 1333599288, 1333599289, 1333599290, 1333599291, 1333599292, 1333599298, 1333599299, 1333599300, 1333599301, 1333599302, 1333599303, 1333599304, 1333598306, 1333598311, 1333598316, 1333598320, 1333598324, 1333598329, 1333598333, 1333598338, 1333598380, 1333598385, 1333598389, 1333598392, 1333598397, 1333598401, 1333598406, 1333598411, 1333598414, 1333598419, 1333598424, 1333598428, 1333598774, 1333598779, 1333598782, 1333599167, 1333599171, 1333599174, 1333599175, 1333599176, 1333599177, 1333599179, 1333599180, 1333599181, 1333599182, 1333599183, 1333599184, 1333599185, 1333599186, 1333599187, 1333599188, 1333599189, 1333598432, 1333598437, 1333598440, 1333598445, 1333598450, 1333598454, 1333598458, 1333598463, 1333598468, 1333598472, 1333598478, 1333598482, 1333598487, 1333598584, 1333598589, 1333598593, 1333598598, 1333598602, 1333598606, 1333598611, 1333599336, 1333599337, 1333599338, 1333599339, 1333599340, 1333599341, 1333599342, 1333599343, 1333599344, 1333599345, 1333599346, 1333599347, 1333599348, 1333599349, 1333599350, 1333599351, 1333599352, 1333599353, 1333599354, 1333599355] number of photos to traite : 195 try to delete the photos incorrect in DB tagging for thcl : 3233 To do loadFromThcl(), then load ParamDescType : thcl3233 thcls : [{'id': 3233, 'mtr_user_id': 31, 'name': 'learn_generique_01122021_6000_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'barquette_opaque,carton,ela,environnement,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_fonce,pet_opaque,textiles_sanitaires', 'svm_portfolios_learning': '4825680,4829009,4825557,4824709,4824714,4824733,4825676,4824737,4824753,4829002,4824848,4824863,4825667,4825677', 'photo_hashtag_type': 4151, 'photo_desc_type': 5557, 'type_classification': 'caffe', 'hashtag_id_list': '2107760128,492774966,492741797,493012381,492636447,2107756122,493202403,492628673,492668766,628944319,2107755846,2107755900,2107759152,2107760129'}] thcl {'id': 3233, 'mtr_user_id': 31, 'name': 'learn_generique_01122021_6000_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'barquette_opaque,carton,ela,environnement,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_fonce,pet_opaque,textiles_sanitaires', 'svm_portfolios_learning': '4825680,4829009,4825557,4824709,4824714,4824733,4825676,4824737,4824753,4829002,4824848,4824863,4825667,4825677', 'photo_hashtag_type': 4151, 'photo_desc_type': 5557, 'type_classification': 'caffe', 'hashtag_id_list': '2107760128,492774966,492741797,493012381,492636447,2107756122,493202403,492628673,492668766,628944319,2107755846,2107755900,2107759152,2107760129'} Update svm_hashtag_type_desc : 5557 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5557, 'learn_generique_01122021_6000_v2', 2048, 2048, 'learn_generique_01122021_6000_v2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 1, 19, 59, 17), datetime.datetime(2021, 12, 1, 19, 59, 17)) To loadFromThcl() : net_5557 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5557, 'learn_generique_01122021_6000_v2', 2048, 2048, 'learn_generique_01122021_6000_v2', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 1, 19, 59, 17), datetime.datetime(2021, 12, 1, 19, 59, 17)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_generique_01122021_6000_v2 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_generique_01122021_6000_v2 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_generique_01122021_6000_v2 /data/models_weight/learn_generique_01122021_6000_v2/caffemodel size_local : 94383085 size in s3 : 94383085 create time local : 2021-12-09 17:03:46 create time in s3 : 2021-12-01 18:45:54 caffemodel already exist and didn't need to update /data/models_weight/learn_generique_01122021_6000_v2/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-09 17:03:46 create time in s3 : 2021-12-01 18:45:53 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_generique_01122021_6000_v2/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-09 17:03:47 create time in s3 : 2021-12-01 18:59:02 mean.npy already exist and didn't need to update /data/models_weight/learn_generique_01122021_6000_v2/synset_words.txt size_local : 454 size in s3 : 454 create time local : 2021-12-09 17:03:47 create time in s3 : 2021-12-01 18:59:15 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_generique_01122021_6000_v2/deploy.prototxt caffemodel_filename : /data/models_weight/learn_generique_01122021_6000_v2/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10776 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.0140297412872314 time used to do the prediction : 0.7260313034057617 save descriptor for thcl : 3233 time to traite the descriptors : 1.109975814819336 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1333598615 To insert : 1333598620 To insert : 1333598624 To insert : 1333598629 To insert : 1333598633 To insert : 1333598637 To insert : 1333598642 To insert : 1333598646 To insert : 1333598651 To insert : 1333598655 To insert : 1333598660 To insert : 1333598664 To insert : 1333598668 To insert : 1333598671 To insert : 1333598675 To insert : 1333598680 To insert : 1333598684 To insert : 1333598761 To insert : 1333598765 To insert : 1333598769 To insert : 1333599190 To insert : 1333599191 To insert : 1333599192 To insert : 1333599193 To insert : 1333599194 To insert : 1333599195 To insert : 1333599196 To insert : 1333599197 To insert : 1333599198 To insert : 1333599199 To insert : 1333599200 To insert : 1333599201 To insert : 1333599202 To insert : 1333599203 To insert : 1333599204 To insert : 1333599205 To insert : 1333599207 To insert : 1333599208 To insert : 1333599209 To insert : 1333599210 To insert : 1333599356 To insert : 1333599357 To insert : 1333599359 To insert : 1333599360 To insert : 1333599361 To insert : 1333599362 To insert : 1333599363 To insert : 1333599364 To insert : 1333599365 To insert : 1333599366 To insert : 1333599367 To insert : 1333599368 To insert : 1333599370 To insert : 1333599372 To insert : 1333599374 To insert : 1333599307 To insert : 1333599308 To insert : 1333599309 To insert : 1333599310 To insert : 1333599311 To insert : 1333599312 To insert : 1333599313 To insert : 1333599314 To insert : 1333599315 To insert : 1333599316 To insert : 1333599317 To insert : 1333599318 To insert : 1333599319 To insert : 1333599329 To insert : 1333599330 To insert : 1333599331 To insert : 1333599332 To insert : 1333599333 To insert : 1333599334 To insert : 1333599335 To insert : 1333599211 To insert : 1333599212 To insert : 1333599213 To insert : 1333599214 To insert : 1333599215 To insert : 1333599216 To insert : 1333599217 To insert : 1333599218 To insert : 1333599219 To insert : 1333599220 To insert : 1333599221 To insert : 1333599222 To insert : 1333599223 To insert : 1333599224 To insert : 1333599225 To insert : 1333599226 To insert : 1333599227 To insert : 1333599228 To insert : 1333599229 To insert : 1333599230 To insert : 1333599231 To insert : 1333599234 To insert : 1333599239 To insert : 1333599242 To insert : 1333599245 To insert : 1333599249 To insert : 1333599252 To insert : 1333599255 To insert : 1333599288 To insert : 1333599289 To insert : 1333599290 To insert : 1333599291 To insert : 1333599292 To insert : 1333599298 To insert : 1333599299 To insert : 1333599300 To insert : 1333599301 To insert : 1333599302 To insert : 1333599303 To insert : 1333599304 To insert : 1333598306 To insert : 1333598311 To insert : 1333598316 To insert : 1333598320 To insert : 1333598324 To insert : 1333598329 To insert : 1333598333 To insert : 1333598338 To insert : 1333598380 To insert : 1333598385 To insert : 1333598389 To insert : 1333598392 To insert : 1333598397 To insert : 1333598401 To insert : 1333598406 To insert : 1333598411 To insert : 1333598414 To insert : 1333598419 To insert : 1333598424 To insert : 1333598428 To insert : 1333598774 To insert : 1333598779 To insert : 1333598782 To insert : 1333599167 To insert : 1333599171 To insert : 1333599174 To insert : 1333599175 To insert : 1333599176 To insert : 1333599177 To insert : 1333599179 To insert : 1333599180 To insert : 1333599181 To insert : 1333599182 To insert : 1333599183 To insert : 1333599184 To insert : 1333599185 To insert : 1333599186 To insert : 1333599187 To insert : 1333599188 To insert : 1333599189 To insert : 1333598432 To insert : 1333598437 To insert : 1333598440 To insert : 1333598445 To insert : 1333598450 To insert : 1333598454 To insert : 1333598458 To insert : 1333598463 To insert : 1333598468 To insert : 1333598472 To insert : 1333598478 To insert : 1333598482 To insert : 1333598487 To insert : 1333598584 To insert : 1333598589 To insert : 1333598593 To insert : 1333598598 To insert : 1333598602 To insert : 1333598606 To insert : 1333598611 To insert : 1333599336 To insert : 1333599337 To insert : 1333599338 To insert : 1333599339 To insert : 1333599340 To insert : 1333599341 To insert : 1333599342 To insert : 1333599343 To insert : 1333599344 To insert : 1333599345 To insert : 1333599346 To insert : 1333599347 To insert : 1333599348 To insert : 1333599349 To insert : 1333599350 To insert : 1333599351 To insert : 1333599352 To insert : 1333599353 To insert : 1333599354 To insert : 1333599355 time to insert the descriptors : 34.56489062309265 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 281 time used for this insertion : 0.02886223793029785 save missing photos in datou_result : time spend for datou_step_exec : 41.57399106025696 time spend to save output : 0.09176278114318848 total time spend for step 5 : 41.66575384140015 step6:argmax Sat Feb 1 05:07:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou_step Argmax ! calculate argmax for thcl : 3233 Inside saveOutput : final : False verbose : 0 photo_id : 1333598615 output[photo_id] : [('1333598615', 'etiquette', 0.63987345, 4151, '3233'), 'temp/1738382667_3255083_1330277570_91d1fa43ca08d7d09ef20a25088b8703_rle_crop_3626352157_0.png'] photo_id : 1333598620 output[photo_id] : [('1333598620', 'barquette_opaque', 0.49049613, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352198_0.png'] photo_id : 1333598624 output[photo_id] : [('1333598624', 'etiquette', 0.6838662, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352201_0.png'] photo_id : 1333598629 output[photo_id] : [('1333598629', 'etiquette', 0.8870482, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352241_0.png'] photo_id : 1333598633 output[photo_id] : [('1333598633', 'etiquette', 0.60499746, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352224_0.png'] photo_id : 1333598637 output[photo_id] : [('1333598637', 'etiquette', 0.82047236, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352223_0.png'] photo_id : 1333598642 output[photo_id] : [('1333598642', 'etiquette', 0.74173033, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352229_0.png'] photo_id : 1333598646 output[photo_id] : [('1333598646', 'papier', 0.55558926, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3648317767_0.png'] photo_id : 1333598651 output[photo_id] : [('1333598651', 'barquette_opaque', 0.5885019, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3648317770_0.png'] photo_id : 1333598655 output[photo_id] : [('1333598655', 'papier', 0.73926955, 4151, '3233'), 'temp/1738382667_3255083_1330277446_c781a1728184ff2acc9e6b73151e4c82_rle_crop_3648317781_0.png'] photo_id : 1333598660 output[photo_id] : [('1333598660', 'papier', 0.9720625, 4151, '3233'), 'temp/1738382667_3255083_1330277381_9dc954d3c22c61b1a234bcbeb22255a8_rle_crop_3648317792_0.png'] photo_id : 1333598664 output[photo_id] : [('1333598664', 'barquette_opaque', 0.58017486, 4151, '3233'), 'temp/1738382667_3255083_1330277381_9dc954d3c22c61b1a234bcbeb22255a8_rle_crop_3626352327_0.png'] photo_id : 1333598668 output[photo_id] : [('1333598668', 'etiquette', 0.53333914, 4151, '3233'), 'temp/1738382667_3255083_1330277381_9dc954d3c22c61b1a234bcbeb22255a8_rle_crop_3648317794_0.png'] photo_id : 1333598671 output[photo_id] : [('1333598671', 'papier', 0.44103137, 4151, '3233'), 'temp/1738382667_3255083_1330277381_9dc954d3c22c61b1a234bcbeb22255a8_rle_crop_3626352311_0.png'] photo_id : 1333598675 output[photo_id] : [('1333598675', 'metal', 0.3029932, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352368_0.png'] photo_id : 1333598680 output[photo_id] : [('1333598680', 'etiquette', 0.39412215, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352359_0.png'] photo_id : 1333598684 output[photo_id] : [('1333598684', 'etiquette', 0.4787862, 4151, '3233'), 'temp/1738382667_3255083_1330277371_195b344d3ca1cd948a2493d051bf77a0_rle_crop_3626352395_0.png'] photo_id : 1333598761 output[photo_id] : [('1333598761', 'metal', 0.74612904, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352196_0.png'] photo_id : 1333598765 output[photo_id] : [('1333598765', 'film_plastique', 0.6479809, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352243_0.png'] photo_id : 1333598769 output[photo_id] : [('1333598769', 'metal', 0.33398417, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352292_0.png'] photo_id : 1333599190 output[photo_id] : [('1333599190', 'etiquette', 0.76336735, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352197_0.png'] photo_id : 1333599191 output[photo_id] : [('1333599191', 'etiquette', 0.60705996, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352206_0.png'] photo_id : 1333599192 output[photo_id] : [('1333599192', 'carton', 0.83442825, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352194_0.png'] photo_id : 1333599193 output[photo_id] : [('1333599193', 'etiquette', 0.9262154, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352184_0.png'] photo_id : 1333599194 output[photo_id] : [('1333599194', 'etiquette', 0.9483847, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352183_0.png'] photo_id : 1333599195 output[photo_id] : [('1333599195', 'etiquette', 0.42130005, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352240_0.png'] photo_id : 1333599196 output[photo_id] : [('1333599196', 'barquette_opaque', 0.7539302, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352233_0.png'] photo_id : 1333599197 output[photo_id] : [('1333599197', 'etiquette', 0.81887275, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352239_0.png'] photo_id : 1333599198 output[photo_id] : [('1333599198', 'metal', 0.9333991, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352218_0.png'] photo_id : 1333599199 output[photo_id] : [('1333599199', 'etiquette', 0.36133027, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3648317769_0.png'] photo_id : 1333599200 output[photo_id] : [('1333599200', 'etiquette', 0.8568545, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352235_0.png'] photo_id : 1333599201 output[photo_id] : [('1333599201', 'pet_opaque', 0.5017393, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352217_0.png'] photo_id : 1333599202 output[photo_id] : [('1333599202', 'barquette_opaque', 0.39165667, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352234_0.png'] photo_id : 1333599203 output[photo_id] : [('1333599203', 'film_plastique', 0.46668422, 4151, '3233'), 'temp/1738382667_3255083_1330277446_c781a1728184ff2acc9e6b73151e4c82_rle_crop_3626352264_0.png'] photo_id : 1333599204 output[photo_id] : [('1333599204', 'papier', 0.47155187, 4151, '3233'), 'temp/1738382667_3255083_1330277446_c781a1728184ff2acc9e6b73151e4c82_rle_crop_3648317778_0.png'] photo_id : 1333599205 output[photo_id] : [('1333599205', 'metal', 0.5217723, 4151, '3233'), 'temp/1738382667_3255083_1330277446_c781a1728184ff2acc9e6b73151e4c82_rle_crop_3648317774_0.png'] photo_id : 1333599207 output[photo_id] : [('1333599207', 'metal', 0.5937858, 4151, '3233'), 'temp/1738382667_3255083_1330277446_c781a1728184ff2acc9e6b73151e4c82_rle_crop_3626352260_0.png'] photo_id : 1333599208 output[photo_id] : [('1333599208', 'papier', 0.5312048, 4151, '3233'), 'temp/1738382667_3255083_1330277446_c781a1728184ff2acc9e6b73151e4c82_rle_crop_3626352268_0.png'] photo_id : 1333599209 output[photo_id] : [('1333599209', 'environnement', 0.43895066, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352285_0.png'] photo_id : 1333599210 output[photo_id] : [('1333599210', 'metal', 0.84995025, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352304_0.png'] photo_id : 1333599356 output[photo_id] : [('1333599356', 'etiquette', 0.52995795, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352291_0.png'] photo_id : 1333599357 output[photo_id] : [('1333599357', 'papier', 0.62593126, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3648317783_0.png'] photo_id : 1333599359 output[photo_id] : [('1333599359', 'barquette_opaque', 0.99991083, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352282_0.png'] photo_id : 1333599360 output[photo_id] : [('1333599360', 'film_plastique', 0.55842644, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352290_0.png'] photo_id : 1333599361 output[photo_id] : [('1333599361', 'pet_opaque', 0.9712702, 4151, '3233'), 'temp/1738382667_3255083_1330277381_9dc954d3c22c61b1a234bcbeb22255a8_rle_crop_3626352315_0.png'] photo_id : 1333599362 output[photo_id] : [('1333599362', 'papier', 0.5870484, 4151, '3233'), 'temp/1738382667_3255083_1330277381_9dc954d3c22c61b1a234bcbeb22255a8_rle_crop_3626352310_0.png'] photo_id : 1333599363 output[photo_id] : [('1333599363', 'pet_opaque', 0.49589655, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352351_0.png'] photo_id : 1333599364 output[photo_id] : [('1333599364', 'papier', 0.93756366, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352370_0.png'] photo_id : 1333599365 output[photo_id] : [('1333599365', 'carton', 0.702719, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352350_0.png'] photo_id : 1333599366 output[photo_id] : [('1333599366', 'papier', 0.579636, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352331_0.png'] photo_id : 1333599367 output[photo_id] : [('1333599367', 'barquette_opaque', 0.66170424, 4151, '3233'), 'temp/1738382667_3255083_1330277371_195b344d3ca1cd948a2493d051bf77a0_rle_crop_3626352383_0.png'] photo_id : 1333599368 output[photo_id] : [('1333599368', 'barquette_opaque', 0.99981314, 4151, '3233'), 'temp/1738382667_3255083_1330277371_195b344d3ca1cd948a2493d051bf77a0_rle_crop_3626352379_0.png'] photo_id : 1333599370 output[photo_id] : [('1333599370', 'pet_opaque', 0.9432959, 4151, '3233'), 'temp/1738382667_3255083_1330277371_195b344d3ca1cd948a2493d051bf77a0_rle_crop_3626352388_0.png'] photo_id : 1333599372 output[photo_id] : [('1333599372', 'carton', 0.26470116, 4151, '3233'), 'temp/1738382667_3255083_1330277371_195b344d3ca1cd948a2493d051bf77a0_rle_crop_3626352392_0.png'] photo_id : 1333599374 output[photo_id] : [('1333599374', 'barquette_opaque', 0.549104, 4151, '3233'), 'temp/1738382667_3255083_1330277371_195b344d3ca1cd948a2493d051bf77a0_rle_crop_3626352377_0.png'] photo_id : 1333599307 output[photo_id] : [('1333599307', 'film_plastique', 0.21278097, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352303_0.png'] photo_id : 1333599308 output[photo_id] : [('1333599308', 'barquette_opaque', 0.77006423, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352298_0.png'] photo_id : 1333599309 output[photo_id] : [('1333599309', 'barquette_opaque', 0.39966732, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352289_0.png'] photo_id : 1333599310 output[photo_id] : [('1333599310', 'barquette_opaque', 0.28749025, 4151, '3233'), 'temp/1738382667_3255083_1330277381_9dc954d3c22c61b1a234bcbeb22255a8_rle_crop_3626352325_0.png'] photo_id : 1333599311 output[photo_id] : [('1333599311', 'etiquette', 0.6795918, 4151, '3233'), 'temp/1738382667_3255083_1330277381_9dc954d3c22c61b1a234bcbeb22255a8_rle_crop_3626352321_0.png'] photo_id : 1333599312 output[photo_id] : [('1333599312', 'pet_clair', 0.2852165, 4151, '3233'), 'temp/1738382667_3255083_1330277381_9dc954d3c22c61b1a234bcbeb22255a8_rle_crop_3626352319_0.png'] photo_id : 1333599313 output[photo_id] : [('1333599313', 'film_plastique', 0.6156264, 4151, '3233'), 'temp/1738382667_3255083_1330277381_9dc954d3c22c61b1a234bcbeb22255a8_rle_crop_3648317791_0.png'] photo_id : 1333599314 output[photo_id] : [('1333599314', 'etiquette', 0.52897954, 4151, '3233'), 'temp/1738382667_3255083_1330277381_9dc954d3c22c61b1a234bcbeb22255a8_rle_crop_3626352329_0.png'] photo_id : 1333599315 output[photo_id] : [('1333599315', 'environnement', 0.249016, 4151, '3233'), 'temp/1738382667_3255083_1330277381_9dc954d3c22c61b1a234bcbeb22255a8_rle_crop_3648317790_0.png'] photo_id : 1333599316 output[photo_id] : [('1333599316', 'metal', 0.5522864, 4151, '3233'), 'temp/1738382667_3255083_1330277381_9dc954d3c22c61b1a234bcbeb22255a8_rle_crop_3626352323_0.png'] photo_id : 1333599317 output[photo_id] : [('1333599317', 'metal', 0.27068144, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352356_0.png'] photo_id : 1333599318 output[photo_id] : [('1333599318', 'metal', 0.9417393, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352352_0.png'] photo_id : 1333599319 output[photo_id] : [('1333599319', 'barquette_opaque', 0.7241562, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352347_0.png'] photo_id : 1333599329 output[photo_id] : [('1333599329', 'pet_opaque', 0.6853201, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352118_0.png'] photo_id : 1333599330 output[photo_id] : [('1333599330', 'carton', 0.4856405, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352119_0.png'] photo_id : 1333599331 output[photo_id] : [('1333599331', 'papier', 0.7554231, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352114_0.png'] photo_id : 1333599332 output[photo_id] : [('1333599332', 'barquette_opaque', 0.6094898, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352130_0.png'] photo_id : 1333599333 output[photo_id] : [('1333599333', 'pet_fonce', 0.5831174, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352123_0.png'] photo_id : 1333599334 output[photo_id] : [('1333599334', 'barquette_opaque', 0.97942, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352142_0.png'] photo_id : 1333599335 output[photo_id] : [('1333599335', 'barquette_opaque', 0.9998486, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352121_0.png'] photo_id : 1333599211 output[photo_id] : [('1333599211', 'pet_fonce', 0.38682044, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352297_0.png'] photo_id : 1333599212 output[photo_id] : [('1333599212', 'pet_fonce', 0.27035263, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352287_0.png'] photo_id : 1333599213 output[photo_id] : [('1333599213', 'papier', 0.61443293, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352302_0.png'] photo_id : 1333599214 output[photo_id] : [('1333599214', 'etiquette', 0.41895413, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352296_0.png'] photo_id : 1333599215 output[photo_id] : [('1333599215', 'etiquette', 0.6307695, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352276_0.png'] photo_id : 1333599216 output[photo_id] : [('1333599216', 'etiquette', 0.55970025, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352281_0.png'] photo_id : 1333599217 output[photo_id] : [('1333599217', 'etiquette', 0.8213062, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352294_0.png'] photo_id : 1333599218 output[photo_id] : [('1333599218', 'metal', 0.4088906, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352275_0.png'] photo_id : 1333599219 output[photo_id] : [('1333599219', 'barquette_opaque', 0.6805146, 4151, '3233'), 'temp/1738382667_3255083_1330277381_9dc954d3c22c61b1a234bcbeb22255a8_rle_crop_3626352322_0.png'] photo_id : 1333599220 output[photo_id] : [('1333599220', 'papier', 0.86429316, 4151, '3233'), 'temp/1738382667_3255083_1330277381_9dc954d3c22c61b1a234bcbeb22255a8_rle_crop_3626352318_0.png'] photo_id : 1333599221 output[photo_id] : [('1333599221', 'papier', 0.9990614, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352344_0.png'] photo_id : 1333599222 output[photo_id] : [('1333599222', 'papier', 0.8578024, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352349_0.png'] photo_id : 1333599223 output[photo_id] : [('1333599223', 'pet_fonce', 0.502661, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352355_0.png'] photo_id : 1333599224 output[photo_id] : [('1333599224', 'etiquette', 0.4676117, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352339_0.png'] photo_id : 1333599225 output[photo_id] : [('1333599225', 'pet_fonce', 0.4872038, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352340_0.png'] photo_id : 1333599226 output[photo_id] : [('1333599226', 'barquette_opaque', 0.46909767, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352343_0.png'] photo_id : 1333599227 output[photo_id] : [('1333599227', 'barquette_opaque', 0.8088435, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352345_0.png'] photo_id : 1333599228 output[photo_id] : [('1333599228', 'papier', 0.9049606, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352361_0.png'] photo_id : 1333599229 output[photo_id] : [('1333599229', 'papier', 0.9553749, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352372_0.png'] photo_id : 1333599230 output[photo_id] : [('1333599230', 'papier', 0.4933968, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352353_0.png'] photo_id : 1333599231 output[photo_id] : [('1333599231', 'etiquette', 0.58603877, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352364_0.png'] photo_id : 1333599234 output[photo_id] : [('1333599234', 'papier', 0.741888, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352354_0.png'] photo_id : 1333599239 output[photo_id] : [('1333599239', 'barquette_opaque', 0.80344397, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352371_0.png'] photo_id : 1333599242 output[photo_id] : [('1333599242', 'environnement', 0.85067284, 4151, '3233'), 'temp/1738382667_3255083_1330277371_195b344d3ca1cd948a2493d051bf77a0_rle_crop_3626352382_0.png'] photo_id : 1333599245 output[photo_id] : [('1333599245', 'carton', 0.55469996, 4151, '3233'), 'temp/1738382667_3255083_1330277371_195b344d3ca1cd948a2493d051bf77a0_rle_crop_3626352389_0.png'] photo_id : 1333599249 output[photo_id] : [('1333599249', 'barquette_opaque', 0.7789469, 4151, '3233'), 'temp/1738382667_3255083_1330277371_195b344d3ca1cd948a2493d051bf77a0_rle_crop_3626352394_0.png'] photo_id : 1333599252 output[photo_id] : [('1333599252', 'pet_fonce', 0.6141585, 4151, '3233'), 'temp/1738382667_3255083_1330277371_195b344d3ca1cd948a2493d051bf77a0_rle_crop_3626352380_0.png'] photo_id : 1333599255 output[photo_id] : [('1333599255', 'metal', 0.35437843, 4151, '3233'), 'temp/1738382667_3255083_1330277371_195b344d3ca1cd948a2493d051bf77a0_rle_crop_3626352391_0.png'] photo_id : 1333599288 output[photo_id] : [('1333599288', 'etiquette', 0.91906625, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352125_0.png'] photo_id : 1333599289 output[photo_id] : [('1333599289', 'papier', 0.369468, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352128_0.png'] photo_id : 1333599290 output[photo_id] : [('1333599290', 'etiquette', 0.9815223, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352116_0.png'] photo_id : 1333599291 output[photo_id] : [('1333599291', 'etiquette', 0.86397916, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352137_0.png'] photo_id : 1333599292 output[photo_id] : [('1333599292', 'etiquette', 0.9421931, 4151, '3233'), 'temp/1738382667_3255083_1330277570_91d1fa43ca08d7d09ef20a25088b8703_rle_crop_3626352159_0.png'] photo_id : 1333599298 output[photo_id] : [('1333599298', 'barquette_opaque', 0.28416267, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352126_0.png'] photo_id : 1333599299 output[photo_id] : [('1333599299', 'etiquette', 0.29567295, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352129_0.png'] photo_id : 1333599300 output[photo_id] : [('1333599300', 'etiquette', 0.36520377, 4151, '3233'), 'temp/1738382667_3255083_1330277570_91d1fa43ca08d7d09ef20a25088b8703_rle_crop_3626352170_0.png'] photo_id : 1333599301 output[photo_id] : [('1333599301', 'pet_clair', 0.4010069, 4151, '3233'), 'temp/1738382667_3255083_1330277570_91d1fa43ca08d7d09ef20a25088b8703_rle_crop_3626352164_0.png'] photo_id : 1333599302 output[photo_id] : [('1333599302', 'etiquette', 0.46920088, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3648317761_0.png'] photo_id : 1333599303 output[photo_id] : [('1333599303', 'barquette_opaque', 0.89110416, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3648317768_0.png'] photo_id : 1333599304 output[photo_id] : [('1333599304', 'etiquette', 0.6206148, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352225_0.png'] photo_id : 1333598306 output[photo_id] : [('1333598306', 'metal', 0.8311354, 4151, '3233'), 'temp/1738382667_3255083_1330277570_91d1fa43ca08d7d09ef20a25088b8703_rle_crop_3648317758_0.png'] photo_id : 1333598311 output[photo_id] : [('1333598311', 'barquette_opaque', 0.64697987, 4151, '3233'), 'temp/1738382667_3255083_1330277570_91d1fa43ca08d7d09ef20a25088b8703_rle_crop_3626352162_0.png'] photo_id : 1333598316 output[photo_id] : [('1333598316', 'papier', 0.30586264, 4151, '3233'), 'temp/1738382667_3255083_1330277570_91d1fa43ca08d7d09ef20a25088b8703_rle_crop_3626352150_0.png'] photo_id : 1333598320 output[photo_id] : [('1333598320', 'film_plastique', 0.43927163, 4151, '3233'), 'temp/1738382667_3255083_1330277570_91d1fa43ca08d7d09ef20a25088b8703_rle_crop_3626352167_0.png'] photo_id : 1333598324 output[photo_id] : [('1333598324', 'papier', 0.38434663, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352199_0.png'] photo_id : 1333598329 output[photo_id] : [('1333598329', 'papier', 0.6778793, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352200_0.png'] photo_id : 1333598333 output[photo_id] : [('1333598333', 'pet_clair', 0.5538949, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352190_0.png'] photo_id : 1333598338 output[photo_id] : [('1333598338', 'metal', 0.7583326, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352181_0.png'] photo_id : 1333598380 output[photo_id] : [('1333598380', 'barquette_opaque', 0.874372, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352185_0.png'] photo_id : 1333598385 output[photo_id] : [('1333598385', 'barquette_opaque', 0.37021545, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352204_0.png'] photo_id : 1333598389 output[photo_id] : [('1333598389', 'barquette_opaque', 0.35066345, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352186_0.png'] photo_id : 1333598392 output[photo_id] : [('1333598392', 'film_plastique', 0.7226689, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352189_0.png'] photo_id : 1333598397 output[photo_id] : [('1333598397', 'papier', 0.5697222, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352216_0.png'] photo_id : 1333598401 output[photo_id] : [('1333598401', 'etiquette', 0.8745939, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352231_0.png'] photo_id : 1333598406 output[photo_id] : [('1333598406', 'pet_clair', 0.4715641, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352221_0.png'] photo_id : 1333598411 output[photo_id] : [('1333598411', 'barquette_opaque', 0.29673415, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352220_0.png'] photo_id : 1333598414 output[photo_id] : [('1333598414', 'barquette_opaque', 0.3205126, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3648317766_0.png'] photo_id : 1333598419 output[photo_id] : [('1333598419', 'barquette_opaque', 0.6225323, 4151, '3233'), 'temp/1738382667_3255083_1330277446_c781a1728184ff2acc9e6b73151e4c82_rle_crop_3626352259_0.png'] photo_id : 1333598424 output[photo_id] : [('1333598424', 'film_plastique', 0.297596, 4151, '3233'), 'temp/1738382667_3255083_1330277446_c781a1728184ff2acc9e6b73151e4c82_rle_crop_3648317777_0.png'] photo_id : 1333598428 output[photo_id] : [('1333598428', 'etiquette', 0.30092856, 4151, '3233'), 'temp/1738382667_3255083_1330277446_c781a1728184ff2acc9e6b73151e4c82_rle_crop_3626352255_0.png'] photo_id : 1333598774 output[photo_id] : [('1333598774', 'barquette_opaque', 0.57800436, 4151, '3233'), 'temp/1738382667_3255083_1330277381_9dc954d3c22c61b1a234bcbeb22255a8_rle_crop_3626352324_0.png'] photo_id : 1333598779 output[photo_id] : [('1333598779', 'barquette_opaque', 0.38770494, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352348_0.png'] photo_id : 1333598782 output[photo_id] : [('1333598782', 'papier', 0.5017636, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352367_0.png'] photo_id : 1333599167 output[photo_id] : [('1333599167', 'papier', 0.60064167, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352141_0.png'] photo_id : 1333599171 output[photo_id] : [('1333599171', 'etiquette', 0.5548703, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352140_0.png'] photo_id : 1333599174 output[photo_id] : [('1333599174', 'etiquette', 0.7773406, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352135_0.png'] photo_id : 1333599175 output[photo_id] : [('1333599175', 'barquette_opaque', 0.7092398, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352143_0.png'] photo_id : 1333599176 output[photo_id] : [('1333599176', 'papier', 0.5833668, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352138_0.png'] photo_id : 1333599177 output[photo_id] : [('1333599177', 'papier', 0.29615614, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352139_0.png'] photo_id : 1333599179 output[photo_id] : [('1333599179', 'etiquette', 0.7460535, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352132_0.png'] photo_id : 1333599180 output[photo_id] : [('1333599180', 'metal', 0.60474926, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352134_0.png'] photo_id : 1333599181 output[photo_id] : [('1333599181', 'papier', 0.27847353, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352133_0.png'] photo_id : 1333599182 output[photo_id] : [('1333599182', 'etiquette', 0.38531008, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352113_0.png'] photo_id : 1333599183 output[photo_id] : [('1333599183', 'papier', 0.24191017, 4151, '3233'), 'temp/1738382667_3255083_1330277570_91d1fa43ca08d7d09ef20a25088b8703_rle_crop_3626352155_0.png'] photo_id : 1333599184 output[photo_id] : [('1333599184', 'papier', 0.7180733, 4151, '3233'), 'temp/1738382667_3255083_1330277570_91d1fa43ca08d7d09ef20a25088b8703_rle_crop_3626352163_0.png'] photo_id : 1333599185 output[photo_id] : [('1333599185', 'carton', 0.39731854, 4151, '3233'), 'temp/1738382667_3255083_1330277570_91d1fa43ca08d7d09ef20a25088b8703_rle_crop_3648317757_0.png'] photo_id : 1333599186 output[photo_id] : [('1333599186', 'etiquette', 0.74990827, 4151, '3233'), 'temp/1738382667_3255083_1330277570_91d1fa43ca08d7d09ef20a25088b8703_rle_crop_3626352161_0.png'] photo_id : 1333599187 output[photo_id] : [('1333599187', 'papier', 0.44408536, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352192_0.png'] photo_id : 1333599188 output[photo_id] : [('1333599188', 'barquette_opaque', 0.7065177, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352191_0.png'] photo_id : 1333599189 output[photo_id] : [('1333599189', 'papier', 0.7132947, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352187_0.png'] photo_id : 1333598432 output[photo_id] : [('1333598432', 'barquette_opaque', 0.5541453, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352284_0.png'] photo_id : 1333598437 output[photo_id] : [('1333598437', 'barquette_opaque', 0.74732506, 4151, '3233'), 'temp/1738382667_3255083_1330277381_9dc954d3c22c61b1a234bcbeb22255a8_rle_crop_3626352316_0.png'] photo_id : 1333598440 output[photo_id] : [('1333598440', 'film_plastique', 0.38533744, 4151, '3233'), 'temp/1738382667_3255083_1330277381_9dc954d3c22c61b1a234bcbeb22255a8_rle_crop_3626352326_0.png'] photo_id : 1333598445 output[photo_id] : [('1333598445', 'barquette_opaque', 0.92104876, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352337_0.png'] photo_id : 1333598450 output[photo_id] : [('1333598450', 'barquette_opaque', 0.4124437, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352362_0.png'] photo_id : 1333598454 output[photo_id] : [('1333598454', 'barquette_opaque', 0.23674603, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352360_0.png'] photo_id : 1333598458 output[photo_id] : [('1333598458', 'papier', 0.49929556, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352357_0.png'] photo_id : 1333598463 output[photo_id] : [('1333598463', 'barquette_opaque', 0.99997175, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352341_0.png'] photo_id : 1333598468 output[photo_id] : [('1333598468', 'pet_fonce', 0.37316516, 4151, '3233'), 'temp/1738382667_3255083_1330277375_43ced89e1aed62b34bb9097a66c0467c_rle_crop_3626352373_0.png'] photo_id : 1333598472 output[photo_id] : [('1333598472', 'barquette_opaque', 0.37780344, 4151, '3233'), 'temp/1738382667_3255083_1330277371_195b344d3ca1cd948a2493d051bf77a0_rle_crop_3626352387_0.png'] photo_id : 1333598478 output[photo_id] : [('1333598478', 'papier', 0.83246, 4151, '3233'), 'temp/1738382667_3255083_1330277371_195b344d3ca1cd948a2493d051bf77a0_rle_crop_3626352390_0.png'] photo_id : 1333598482 output[photo_id] : [('1333598482', 'etiquette', 0.7214157, 4151, '3233'), 'temp/1738382667_3255083_1330277371_195b344d3ca1cd948a2493d051bf77a0_rle_crop_3626352385_0.png'] photo_id : 1333598487 output[photo_id] : [('1333598487', 'metal', 0.26144943, 4151, '3233'), 'temp/1738382667_3255083_1330277371_195b344d3ca1cd948a2493d051bf77a0_rle_crop_3626352386_0.png'] photo_id : 1333598584 output[photo_id] : [('1333598584', 'papier', 0.99396694, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352124_0.png'] photo_id : 1333598589 output[photo_id] : [('1333598589', 'etiquette', 0.9148944, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352131_0.png'] photo_id : 1333598593 output[photo_id] : [('1333598593', 'metal', 0.58865404, 4151, '3233'), 'temp/1738382667_3255083_1330277594_f059c53325dbd08f88858b1d8ffc6941_rle_crop_3626352127_0.png'] photo_id : 1333598598 output[photo_id] : [('1333598598', 'etiquette', 0.83529615, 4151, '3233'), 'temp/1738382667_3255083_1330277570_91d1fa43ca08d7d09ef20a25088b8703_rle_crop_3626352153_0.png'] photo_id : 1333598602 output[photo_id] : [('1333598602', 'etiquette', 0.43684268, 4151, '3233'), 'temp/1738382667_3255083_1330277570_91d1fa43ca08d7d09ef20a25088b8703_rle_crop_3626352168_0.png'] photo_id : 1333598606 output[photo_id] : [('1333598606', 'papier', 0.76930755, 4151, '3233'), 'temp/1738382667_3255083_1330277570_91d1fa43ca08d7d09ef20a25088b8703_rle_crop_3626352166_0.png'] photo_id : 1333598611 output[photo_id] : [('1333598611', 'etiquette', 0.55588526, 4151, '3233'), 'temp/1738382667_3255083_1330277570_91d1fa43ca08d7d09ef20a25088b8703_rle_crop_3626352158_0.png'] photo_id : 1333599336 output[photo_id] : [('1333599336', 'barquette_opaque', 0.824307, 4151, '3233'), 'temp/1738382667_3255083_1330277570_91d1fa43ca08d7d09ef20a25088b8703_rle_crop_3626352156_0.png'] photo_id : 1333599337 output[photo_id] : [('1333599337', 'barquette_opaque', 0.9915843, 4151, '3233'), 'temp/1738382667_3255083_1330277570_91d1fa43ca08d7d09ef20a25088b8703_rle_crop_3626352169_0.png'] photo_id : 1333599338 output[photo_id] : [('1333599338', 'barquette_opaque', 0.964622, 4151, '3233'), 'temp/1738382667_3255083_1330277570_91d1fa43ca08d7d09ef20a25088b8703_rle_crop_3648317759_0.png'] photo_id : 1333599339 output[photo_id] : [('1333599339', 'etiquette', 0.5927603, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352203_0.png'] photo_id : 1333599340 output[photo_id] : [('1333599340', 'metal', 0.8860083, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352176_0.png'] photo_id : 1333599341 output[photo_id] : [('1333599341', 'barquette_opaque', 0.49715707, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352202_0.png'] photo_id : 1333599342 output[photo_id] : [('1333599342', 'barquette_opaque', 0.8528229, 4151, '3233'), 'temp/1738382667_3255083_1330277567_8084aafbbb9ef67e921e15d7cffd4986_rle_crop_3626352188_0.png'] photo_id : 1333599343 output[photo_id] : [('1333599343', 'pet_fonce', 0.39015463, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352230_0.png'] photo_id : 1333599344 output[photo_id] : [('1333599344', 'barquette_opaque', 0.99760807, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352237_0.png'] photo_id : 1333599345 output[photo_id] : [('1333599345', 'papier', 0.98744464, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352238_0.png'] photo_id : 1333599346 output[photo_id] : [('1333599346', 'etiquette', 0.7818314, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352245_0.png'] photo_id : 1333599347 output[photo_id] : [('1333599347', 'barquette_opaque', 0.97715557, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352222_0.png'] photo_id : 1333599348 output[photo_id] : [('1333599348', 'etiquette', 0.5837065, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352226_0.png'] photo_id : 1333599349 output[photo_id] : [('1333599349', 'papier', 0.34828085, 4151, '3233'), 'temp/1738382667_3255083_1330277562_336be580ff4a7d7441fc2361f82c99ed_rle_crop_3626352232_0.png'] photo_id : 1333599350 output[photo_id] : [('1333599350', 'etiquette', 0.4270872, 4151, '3233'), 'temp/1738382667_3255083_1330277446_c781a1728184ff2acc9e6b73151e4c82_rle_crop_3648317782_0.png'] photo_id : 1333599351 output[photo_id] : [('1333599351', 'barquette_opaque', 0.521116, 4151, '3233'), 'temp/1738382667_3255083_1330277446_c781a1728184ff2acc9e6b73151e4c82_rle_crop_3626352267_0.png'] photo_id : 1333599352 output[photo_id] : [('1333599352', 'pet_opaque', 0.63511187, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352300_0.png'] photo_id : 1333599353 output[photo_id] : [('1333599353', 'metal', 0.36529258, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352283_0.png'] photo_id : 1333599354 output[photo_id] : [('1333599354', 'papier', 0.6015106, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352299_0.png'] photo_id : 1333599355 output[photo_id] : [('1333599355', 'papier', 0.6407891, 4151, '3233'), 'temp/1738382667_3255083_1330277412_6c1c792f2c1aa7bfe66805e91982a00a_rle_crop_3626352295_0.png'] begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 195 time used for this insertion : 0.11576175689697266 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 195 time used for this insertion : 0.023550987243652344 save missing photos in datou_result : time spend for datou_step_exec : 0.0075533390045166016 time spend to save output : 0.1420128345489502 total time spend for step 6 : 0.1495661735534668 step7:merge_mask_thcl_custom Sat Feb 1 05:07:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step merge_mask_thcl_custom this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it this is a sub image , we ignore it batch 1 Loaded 330 chid ids of type : 3760 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++As expected we have just one thcl present begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : begin to find the sub_photo_id : batch 1 Loaded 195 chid ids of type : 4210 Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! batch 1 Loaded 195 chid ids of type : 4210 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++End of step merge_mask_thcl_custom Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : merge_mask_thcl_custom we use saveGeneral [1330277594, 1330277570, 1330277567, 1330277562, 1330277446, 1330277412, 1330277381, 1330277375, 1330277371] Looping around the photos to save general results len do output : 9 /1330277594Didn't retrieve data .Didn't retrieve data . /1330277570Didn't retrieve data .Didn't retrieve data . /1330277567Didn't retrieve data .Didn't retrieve data . /1330277562Didn't retrieve data .Didn't retrieve data . /1330277446Didn't retrieve data .Didn't retrieve data . /1330277412Didn't retrieve data .Didn't retrieve data . /1330277381Didn't retrieve data .Didn't retrieve data . /1330277375Didn't retrieve data .Didn't retrieve data . /1330277371Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277594', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277570', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277567', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277562', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277446', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277412', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277381', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277375', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277371', None, None, None, None, None, '2533516') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.015102386474609375 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.9504547119140625 time spend to save output : 0.01565861701965332 total time spend for step 7 : 2.966113328933716 step8:rle_unique_nms_with_priority Sat Feb 1 05:07:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms nb_obj : 26 nb_hashtags : 7 time to prepare the origin masks : 2.558021068572998 time for calcul the mask position with numpy : 0.15169572830200195 nb_pixel_total : 1809196 time to create 1 rle with new method : 0.09442543983459473 time for calcul the mask position with numpy : 0.009022235870361328 nb_pixel_total : 5136 time to create 1 rle with old method : 0.005884885787963867 time for calcul the mask position with numpy : 0.008899211883544922 nb_pixel_total : 2577 time to create 1 rle with old method : 0.002891063690185547 time for calcul the mask position with numpy : 0.008725166320800781 nb_pixel_total : 2957 time to create 1 rle with old method : 0.0035295486450195312 time for calcul the mask position with numpy : 0.008699893951416016 nb_pixel_total : 4692 time to create 1 rle with old method : 0.005135297775268555 time for calcul the mask position with numpy : 0.008554935455322266 nb_pixel_total : 4697 time to create 1 rle with old method : 0.005349159240722656 time for calcul the mask position with numpy : 0.008773326873779297 nb_pixel_total : 7630 time to create 1 rle with old method : 0.008738994598388672 time for calcul the mask position with numpy : 0.0094146728515625 nb_pixel_total : 58696 time to create 1 rle with old method : 0.06351947784423828 time for calcul the mask position with numpy : 0.008574962615966797 nb_pixel_total : 5075 time to create 1 rle with old method : 0.0058476924896240234 time for calcul the mask position with numpy : 0.0088043212890625 nb_pixel_total : 5717 time to create 1 rle with old method : 0.006566524505615234 time for calcul the mask position with numpy : 0.008568763732910156 nb_pixel_total : 4110 time to create 1 rle with old method : 0.0049779415130615234 time for calcul the mask position with numpy : 0.009024381637573242 nb_pixel_total : 7097 time to create 1 rle with old method : 0.008217811584472656 time for calcul the mask position with numpy : 0.008836984634399414 nb_pixel_total : 13519 time to create 1 rle with old method : 0.015594005584716797 time for calcul the mask position with numpy : 0.009584188461303711 nb_pixel_total : 1043 time to create 1 rle with old method : 0.0012969970703125 time for calcul the mask position with numpy : 0.00990605354309082 nb_pixel_total : 1574 time to create 1 rle with old method : 0.002287149429321289 time for calcul the mask position with numpy : 0.009344816207885742 nb_pixel_total : 42992 time to create 1 rle with old method : 0.04853367805480957 time for calcul the mask position with numpy : 0.008826017379760742 nb_pixel_total : 3209 time to create 1 rle with old method : 0.003668069839477539 time for calcul the mask position with numpy : 0.008806705474853516 nb_pixel_total : 10706 time to create 1 rle with old method : 0.012128114700317383 time for calcul the mask position with numpy : 0.008908748626708984 nb_pixel_total : 17001 time to create 1 rle with old method : 0.023947954177856445 time for calcul the mask position with numpy : 0.009943008422851562 nb_pixel_total : 2429 time to create 1 rle with old method : 0.004079341888427734 time for calcul the mask position with numpy : 0.010013103485107422 nb_pixel_total : 9010 time to create 1 rle with old method : 0.014689207077026367 time for calcul the mask position with numpy : 0.009869575500488281 nb_pixel_total : 2320 time to create 1 rle with old method : 0.003834247589111328 time for calcul the mask position with numpy : 0.011059999465942383 nb_pixel_total : 22732 time to create 1 rle with old method : 0.027470111846923828 time for calcul the mask position with numpy : 0.011702775955200195 nb_pixel_total : 5907 time to create 1 rle with old method : 0.010752439498901367 time for calcul the mask position with numpy : 0.011221885681152344 nb_pixel_total : 9958 time to create 1 rle with old method : 0.017853736877441406 time for calcul the mask position with numpy : 0.011628866195678711 nb_pixel_total : 9494 time to create 1 rle with old method : 0.022592782974243164 time for calcul the mask position with numpy : 0.013365983963012695 nb_pixel_total : 4126 time to create 1 rle with old method : 0.006131649017333984 create new chi : 0.8444783687591553 time to delete rle : 0.05085492134094238 batch 1 Loaded 53 chid ids of type : 4211 Number RLEs to save : 6908 TO DO : save crop sub photo not yet done ! save time : 2.9055800437927246 nb_obj : 19 nb_hashtags : 7 time to prepare the origin masks : 2.1745028495788574 time for calcul the mask position with numpy : 0.0333247184753418 nb_pixel_total : 1862885 time to create 1 rle with new method : 0.06268119812011719 time for calcul the mask position with numpy : 0.006297111511230469 nb_pixel_total : 976 time to create 1 rle with old method : 0.0011212825775146484 time for calcul the mask position with numpy : 0.006152153015136719 nb_pixel_total : 18562 time to create 1 rle with old method : 0.019997596740722656 time for calcul the mask position with numpy : 0.006204128265380859 nb_pixel_total : 12781 time to create 1 rle with old method : 0.013552665710449219 time for calcul the mask position with numpy : 0.006467342376708984 nb_pixel_total : 35391 time to create 1 rle with old method : 0.037168025970458984 time for calcul the mask position with numpy : 0.006154775619506836 nb_pixel_total : 14161 time to create 1 rle with old method : 0.015767335891723633 time for calcul the mask position with numpy : 0.006180763244628906 nb_pixel_total : 7700 time to create 1 rle with old method : 0.008207082748413086 time for calcul the mask position with numpy : 0.0062601566314697266 nb_pixel_total : 23318 time to create 1 rle with old method : 0.025205135345458984 time for calcul the mask position with numpy : 0.005970478057861328 nb_pixel_total : 7993 time to create 1 rle with old method : 0.00830841064453125 time for calcul the mask position with numpy : 0.005872011184692383 nb_pixel_total : 4520 time to create 1 rle with old method : 0.0050427913665771484 time for calcul the mask position with numpy : 0.006224632263183594 nb_pixel_total : 13381 time to create 1 rle with old method : 0.014885425567626953 time for calcul the mask position with numpy : 0.006073951721191406 nb_pixel_total : 10026 time to create 1 rle with old method : 0.010666847229003906 time for calcul the mask position with numpy : 0.0058994293212890625 nb_pixel_total : 3187 time to create 1 rle with old method : 0.003420591354370117 time for calcul the mask position with numpy : 0.005918979644775391 nb_pixel_total : 12622 time to create 1 rle with old method : 0.013419151306152344 time for calcul the mask position with numpy : 0.006215810775756836 nb_pixel_total : 10461 time to create 1 rle with old method : 0.011249065399169922 time for calcul the mask position with numpy : 0.006291627883911133 nb_pixel_total : 6715 time to create 1 rle with old method : 0.0074498653411865234 time for calcul the mask position with numpy : 0.00606083869934082 nb_pixel_total : 9453 time to create 1 rle with old method : 0.010249137878417969 time for calcul the mask position with numpy : 0.006055355072021484 nb_pixel_total : 4657 time to create 1 rle with old method : 0.005166053771972656 time for calcul the mask position with numpy : 0.0060694217681884766 nb_pixel_total : 9385 time to create 1 rle with old method : 0.009844064712524414 time for calcul the mask position with numpy : 0.005911588668823242 nb_pixel_total : 5426 time to create 1 rle with old method : 0.00574803352355957 create new chi : 0.43996405601501465 time to delete rle : 0.0006439685821533203 batch 1 Loaded 39 chid ids of type : 4211 Number RLEs to save : 6612 TO DO : save crop sub photo not yet done ! save time : 2.1212151050567627 nb_obj : 24 nb_hashtags : 7 time to prepare the origin masks : 1.6604228019714355 time for calcul the mask position with numpy : 0.0550997257232666 nb_pixel_total : 1837084 time to create 1 rle with new method : 0.14199209213256836 time for calcul the mask position with numpy : 0.006387948989868164 nb_pixel_total : 18375 time to create 1 rle with old method : 0.019713878631591797 time for calcul the mask position with numpy : 0.0060651302337646484 nb_pixel_total : 5540 time to create 1 rle with old method : 0.005973339080810547 time for calcul the mask position with numpy : 0.0060787200927734375 nb_pixel_total : 10379 time to create 1 rle with old method : 0.010999679565429688 time for calcul the mask position with numpy : 0.006074190139770508 nb_pixel_total : 684 time to create 1 rle with old method : 0.0007719993591308594 time for calcul the mask position with numpy : 0.006223201751708984 nb_pixel_total : 12656 time to create 1 rle with old method : 0.013184547424316406 time for calcul the mask position with numpy : 0.006113529205322266 nb_pixel_total : 7189 time to create 1 rle with old method : 0.007575511932373047 time for calcul the mask position with numpy : 0.006016731262207031 nb_pixel_total : 5227 time to create 1 rle with old method : 0.0054662227630615234 time for calcul the mask position with numpy : 0.006212949752807617 nb_pixel_total : 17913 time to create 1 rle with old method : 0.01929497718811035 time for calcul the mask position with numpy : 0.006144285202026367 nb_pixel_total : 4302 time to create 1 rle with old method : 0.00466465950012207 time for calcul the mask position with numpy : 0.0063304901123046875 nb_pixel_total : 3642 time to create 1 rle with old method : 0.003979921340942383 time for calcul the mask position with numpy : 0.0066051483154296875 nb_pixel_total : 5421 time to create 1 rle with old method : 0.006010770797729492 time for calcul the mask position with numpy : 0.006813764572143555 nb_pixel_total : 3104 time to create 1 rle with old method : 0.003450632095336914 time for calcul the mask position with numpy : 0.0066339969635009766 nb_pixel_total : 9746 time to create 1 rle with old method : 0.011111259460449219 time for calcul the mask position with numpy : 0.0065746307373046875 nb_pixel_total : 9532 time to create 1 rle with old method : 0.010738849639892578 time for calcul the mask position with numpy : 0.006338834762573242 nb_pixel_total : 15358 time to create 1 rle with old method : 0.01656484603881836 time for calcul the mask position with numpy : 0.006134510040283203 nb_pixel_total : 3509 time to create 1 rle with old method : 0.0038421154022216797 time for calcul the mask position with numpy : 0.0065326690673828125 nb_pixel_total : 8798 time to create 1 rle with old method : 0.009571552276611328 time for calcul the mask position with numpy : 0.0062274932861328125 nb_pixel_total : 2961 time to create 1 rle with old method : 0.003369569778442383 time for calcul the mask position with numpy : 0.006434202194213867 nb_pixel_total : 32595 time to create 1 rle with old method : 0.03641343116760254 time for calcul the mask position with numpy : 0.0063877105712890625 nb_pixel_total : 24385 time to create 1 rle with old method : 0.044446706771850586 time for calcul the mask position with numpy : 0.00964212417602539 nb_pixel_total : 7816 time to create 1 rle with old method : 0.008412361145019531 time for calcul the mask position with numpy : 0.006623983383178711 nb_pixel_total : 20870 time to create 1 rle with old method : 0.02330183982849121 time for calcul the mask position with numpy : 0.006461620330810547 nb_pixel_total : 4057 time to create 1 rle with old method : 0.0044209957122802734 time for calcul the mask position with numpy : 0.006446123123168945 nb_pixel_total : 2457 time to create 1 rle with old method : 0.002697467803955078 create new chi : 0.6430139541625977 time to delete rle : 0.0008192062377929688 batch 1 Loaded 49 chid ids of type : 4211 Number RLEs to save : 7194 TO DO : save crop sub photo not yet done ! save time : 1.2501888275146484 nb_obj : 29 nb_hashtags : 8 time to prepare the origin masks : 2.5235114097595215 time for calcul the mask position with numpy : 0.09637761116027832 nb_pixel_total : 1816452 time to create 1 rle with new method : 0.07581520080566406 time for calcul the mask position with numpy : 0.005990505218505859 nb_pixel_total : 11317 time to create 1 rle with old method : 0.011658430099487305 time for calcul the mask position with numpy : 0.006273031234741211 nb_pixel_total : 7764 time to create 1 rle with old method : 0.008088111877441406 time for calcul the mask position with numpy : 0.005974769592285156 nb_pixel_total : 2230 time to create 1 rle with old method : 0.0024085044860839844 time for calcul the mask position with numpy : 0.006022930145263672 nb_pixel_total : 13334 time to create 1 rle with old method : 0.014121294021606445 time for calcul the mask position with numpy : 0.005916118621826172 nb_pixel_total : 4481 time to create 1 rle with old method : 0.004652261734008789 time for calcul the mask position with numpy : 0.006005048751831055 nb_pixel_total : 26980 time to create 1 rle with old method : 0.027982473373413086 time for calcul the mask position with numpy : 0.006066560745239258 nb_pixel_total : 4762 time to create 1 rle with old method : 0.005193233489990234 time for calcul the mask position with numpy : 0.005990028381347656 nb_pixel_total : 8674 time to create 1 rle with old method : 0.009250164031982422 time for calcul the mask position with numpy : 0.0059430599212646484 nb_pixel_total : 21005 time to create 1 rle with old method : 0.02243661880493164 time for calcul the mask position with numpy : 0.006532430648803711 nb_pixel_total : 199 time to create 1 rle with old method : 0.0003559589385986328 time for calcul the mask position with numpy : 0.006374835968017578 nb_pixel_total : 6880 time to create 1 rle with old method : 0.007452249526977539 time for calcul the mask position with numpy : 0.006196498870849609 nb_pixel_total : 6336 time to create 1 rle with old method : 0.00700068473815918 time for calcul the mask position with numpy : 0.006288051605224609 nb_pixel_total : 9063 time to create 1 rle with old method : 0.009894371032714844 time for calcul the mask position with numpy : 0.006281375885009766 nb_pixel_total : 12280 time to create 1 rle with old method : 0.013806343078613281 time for calcul the mask position with numpy : 0.006288766860961914 nb_pixel_total : 8309 time to create 1 rle with old method : 0.0089263916015625 time for calcul the mask position with numpy : 0.006429910659790039 nb_pixel_total : 5336 time to create 1 rle with old method : 0.0057871341705322266 time for calcul the mask position with numpy : 0.006243705749511719 nb_pixel_total : 4837 time to create 1 rle with old method : 0.0052678585052490234 time for calcul the mask position with numpy : 0.006247282028198242 nb_pixel_total : 4739 time to create 1 rle with old method : 0.005117654800415039 time for calcul the mask position with numpy : 0.006133317947387695 nb_pixel_total : 19536 time to create 1 rle with old method : 0.02190256118774414 time for calcul the mask position with numpy : 0.006118059158325195 nb_pixel_total : 3251 time to create 1 rle with old method : 0.0034580230712890625 time for calcul the mask position with numpy : 0.0058441162109375 nb_pixel_total : 5425 time to create 1 rle with old method : 0.005976200103759766 time for calcul the mask position with numpy : 0.005973100662231445 nb_pixel_total : 481 time to create 1 rle with old method : 0.0006504058837890625 time for calcul the mask position with numpy : 0.006028652191162109 nb_pixel_total : 16666 time to create 1 rle with old method : 0.017699241638183594 time for calcul the mask position with numpy : 0.0058748722076416016 nb_pixel_total : 414 time to create 1 rle with old method : 0.00048279762268066406 time for calcul the mask position with numpy : 0.0058248043060302734 nb_pixel_total : 7862 time to create 1 rle with old method : 0.008057355880737305 time for calcul the mask position with numpy : 0.008407831192016602 nb_pixel_total : 5317 time to create 1 rle with old method : 0.005625247955322266 time for calcul the mask position with numpy : 0.008147478103637695 nb_pixel_total : 12712 time to create 1 rle with old method : 0.014039754867553711 time for calcul the mask position with numpy : 0.008221626281738281 nb_pixel_total : 23766 time to create 1 rle with old method : 0.02582097053527832 time for calcul the mask position with numpy : 0.008059978485107422 nb_pixel_total : 3192 time to create 1 rle with old method : 0.003329038619995117 create new chi : 0.6452438831329346 time to delete rle : 0.0007739067077636719 batch 1 Loaded 58 chid ids of type : 4211 Number RLEs to save : 7841 TO DO : save crop sub photo not yet done ! save time : 3.391008138656616 nb_obj : 11 nb_hashtags : 5 time to prepare the origin masks : 0.8746509552001953 time for calcul the mask position with numpy : 0.025340795516967773 nb_pixel_total : 1938305 time to create 1 rle with new method : 0.04282855987548828 time for calcul the mask position with numpy : 0.005990266799926758 nb_pixel_total : 17719 time to create 1 rle with old method : 0.019361495971679688 time for calcul the mask position with numpy : 0.00594782829284668 nb_pixel_total : 9273 time to create 1 rle with old method : 0.010123014450073242 time for calcul the mask position with numpy : 0.0059528350830078125 nb_pixel_total : 7663 time to create 1 rle with old method : 0.007848978042602539 time for calcul the mask position with numpy : 0.005767107009887695 nb_pixel_total : 13485 time to create 1 rle with old method : 0.014211177825927734 time for calcul the mask position with numpy : 0.005834102630615234 nb_pixel_total : 12268 time to create 1 rle with old method : 0.012479543685913086 time for calcul the mask position with numpy : 0.005761861801147461 nb_pixel_total : 11478 time to create 1 rle with old method : 0.012066125869750977 time for calcul the mask position with numpy : 0.0061910152435302734 nb_pixel_total : 24019 time to create 1 rle with old method : 0.02532172203063965 time for calcul the mask position with numpy : 0.00684046745300293 nb_pixel_total : 7817 time to create 1 rle with old method : 0.008035659790039062 time for calcul the mask position with numpy : 0.0071697235107421875 nb_pixel_total : 2633 time to create 1 rle with old method : 0.0027365684509277344 time for calcul the mask position with numpy : 0.006632566452026367 nb_pixel_total : 22460 time to create 1 rle with old method : 0.023017168045043945 time for calcul the mask position with numpy : 0.005932331085205078 nb_pixel_total : 6480 time to create 1 rle with old method : 0.006855010986328125 create new chi : 0.2790367603302002 time to delete rle : 0.0005030632019042969 batch 1 Loaded 24 chid ids of type : 4211 Number RLEs to save : 3864 TO DO : save crop sub photo not yet done ! save time : 0.8508210182189941 nb_obj : 23 nb_hashtags : 8 time to prepare the origin masks : 1.7648751735687256 time for calcul the mask position with numpy : 0.03842878341674805 nb_pixel_total : 1818177 time to create 1 rle with new method : 0.0559697151184082 time for calcul the mask position with numpy : 0.006741046905517578 nb_pixel_total : 8653 time to create 1 rle with old method : 0.008879661560058594 time for calcul the mask position with numpy : 0.006847381591796875 nb_pixel_total : 12081 time to create 1 rle with old method : 0.012879610061645508 time for calcul the mask position with numpy : 0.011244773864746094 nb_pixel_total : 3772 time to create 1 rle with old method : 0.004126787185668945 time for calcul the mask position with numpy : 0.011420249938964844 nb_pixel_total : 16864 time to create 1 rle with old method : 0.01742386817932129 time for calcul the mask position with numpy : 0.006845951080322266 nb_pixel_total : 13869 time to create 1 rle with old method : 0.014175653457641602 time for calcul the mask position with numpy : 0.006819486618041992 nb_pixel_total : 7360 time to create 1 rle with old method : 0.007978439331054688 time for calcul the mask position with numpy : 0.0070879459381103516 nb_pixel_total : 5976 time to create 1 rle with old method : 0.0064105987548828125 time for calcul the mask position with numpy : 0.006632328033447266 nb_pixel_total : 5453 time to create 1 rle with old method : 0.005788564682006836 time for calcul the mask position with numpy : 0.0067958831787109375 nb_pixel_total : 14076 time to create 1 rle with old method : 0.015305757522583008 time for calcul the mask position with numpy : 0.006457090377807617 nb_pixel_total : 4023 time to create 1 rle with old method : 0.004135608673095703 time for calcul the mask position with numpy : 0.006602764129638672 nb_pixel_total : 8956 time to create 1 rle with old method : 0.00917673110961914 time for calcul the mask position with numpy : 0.006948232650756836 nb_pixel_total : 25183 time to create 1 rle with old method : 0.02727985382080078 time for calcul the mask position with numpy : 0.00732421875 nb_pixel_total : 11528 time to create 1 rle with old method : 0.012519598007202148 time for calcul the mask position with numpy : 0.006978273391723633 nb_pixel_total : 45261 time to create 1 rle with old method : 0.0490269660949707 time for calcul the mask position with numpy : 0.006918907165527344 nb_pixel_total : 9474 time to create 1 rle with old method : 0.01047372817993164 time for calcul the mask position with numpy : 0.007003307342529297 nb_pixel_total : 3621 time to create 1 rle with old method : 0.003971576690673828 time for calcul the mask position with numpy : 0.007180690765380859 nb_pixel_total : 8871 time to create 1 rle with old method : 0.00953221321105957 time for calcul the mask position with numpy : 0.006766796112060547 nb_pixel_total : 18756 time to create 1 rle with old method : 0.020453214645385742 time for calcul the mask position with numpy : 0.006708860397338867 nb_pixel_total : 5421 time to create 1 rle with old method : 0.005459308624267578 time for calcul the mask position with numpy : 0.006567716598510742 nb_pixel_total : 7844 time to create 1 rle with old method : 0.008408069610595703 time for calcul the mask position with numpy : 0.0066492557525634766 nb_pixel_total : 1230 time to create 1 rle with old method : 0.001348257064819336 time for calcul the mask position with numpy : 0.006420135498046875 nb_pixel_total : 1495 time to create 1 rle with old method : 0.0016779899597167969 time for calcul the mask position with numpy : 0.0069429874420166016 nb_pixel_total : 15656 time to create 1 rle with old method : 0.01567220687866211 create new chi : 0.5341475009918213 time to delete rle : 0.0009300708770751953 batch 1 Loaded 47 chid ids of type : 4211 Number RLEs to save : 6686 TO DO : save crop sub photo not yet done ! save time : 0.7278015613555908 nb_obj : 18 nb_hashtags : 8 time to prepare the origin masks : 1.372690200805664 time for calcul the mask position with numpy : 0.03183126449584961 nb_pixel_total : 1903330 time to create 1 rle with new method : 0.046736717224121094 time for calcul the mask position with numpy : 0.010820388793945312 nb_pixel_total : 8547 time to create 1 rle with old method : 0.009860038757324219 time for calcul the mask position with numpy : 0.010720014572143555 nb_pixel_total : 63 time to create 1 rle with old method : 0.00015616416931152344 time for calcul the mask position with numpy : 0.006040096282958984 nb_pixel_total : 3759 time to create 1 rle with old method : 0.004317760467529297 time for calcul the mask position with numpy : 0.006445884704589844 nb_pixel_total : 11877 time to create 1 rle with old method : 0.013413667678833008 time for calcul the mask position with numpy : 0.006763458251953125 nb_pixel_total : 3568 time to create 1 rle with old method : 0.004158496856689453 time for calcul the mask position with numpy : 0.010394811630249023 nb_pixel_total : 8316 time to create 1 rle with old method : 0.009355545043945312 time for calcul the mask position with numpy : 0.010483503341674805 nb_pixel_total : 888 time to create 1 rle with old method : 0.0011019706726074219 time for calcul the mask position with numpy : 0.006823062896728516 nb_pixel_total : 7711 time to create 1 rle with old method : 0.008696794509887695 time for calcul the mask position with numpy : 0.010503053665161133 nb_pixel_total : 7344 time to create 1 rle with old method : 0.00803375244140625 time for calcul the mask position with numpy : 0.010368108749389648 nb_pixel_total : 4161 time to create 1 rle with old method : 0.004679679870605469 time for calcul the mask position with numpy : 0.009834051132202148 nb_pixel_total : 22290 time to create 1 rle with old method : 0.023773908615112305 time for calcul the mask position with numpy : 0.010619401931762695 nb_pixel_total : 11341 time to create 1 rle with old method : 0.013505220413208008 time for calcul the mask position with numpy : 0.0063283443450927734 nb_pixel_total : 9868 time to create 1 rle with old method : 0.014651298522949219 time for calcul the mask position with numpy : 0.010180950164794922 nb_pixel_total : 9394 time to create 1 rle with old method : 0.010383129119873047 time for calcul the mask position with numpy : 0.010039091110229492 nb_pixel_total : 15591 time to create 1 rle with old method : 0.016350507736206055 time for calcul the mask position with numpy : 0.010205507278442383 nb_pixel_total : 6944 time to create 1 rle with old method : 0.007737874984741211 time for calcul the mask position with numpy : 0.010858774185180664 nb_pixel_total : 26089 time to create 1 rle with old method : 0.029251575469970703 time for calcul the mask position with numpy : 0.011725187301635742 nb_pixel_total : 12519 time to create 1 rle with old method : 0.013934612274169922 create new chi : 0.44225502014160156 time to delete rle : 0.000598907470703125 batch 1 Loaded 37 chid ids of type : 4211 Number RLEs to save : 5447 TO DO : save crop sub photo not yet done ! save time : 2.499753713607788 nb_obj : 30 nb_hashtags : 7 time to prepare the origin masks : 3.1006386280059814 time for calcul the mask position with numpy : 0.18152832984924316 nb_pixel_total : 1666456 time to create 1 rle with new method : 0.0861961841583252 time for calcul the mask position with numpy : 0.01068878173828125 nb_pixel_total : 5086 time to create 1 rle with old method : 0.005828380584716797 time for calcul the mask position with numpy : 0.010683774948120117 nb_pixel_total : 2615 time to create 1 rle with old method : 0.0028574466705322266 time for calcul the mask position with numpy : 0.010370016098022461 nb_pixel_total : 1736 time to create 1 rle with old method : 0.002107858657836914 time for calcul the mask position with numpy : 0.01049661636352539 nb_pixel_total : 17343 time to create 1 rle with old method : 0.01853322982788086 time for calcul the mask position with numpy : 0.010181188583374023 nb_pixel_total : 29822 time to create 1 rle with old method : 0.03269362449645996 time for calcul the mask position with numpy : 0.009624958038330078 nb_pixel_total : 16471 time to create 1 rle with old method : 0.01747441291809082 time for calcul the mask position with numpy : 0.01015925407409668 nb_pixel_total : 12808 time to create 1 rle with old method : 0.013731718063354492 time for calcul the mask position with numpy : 0.009491920471191406 nb_pixel_total : 14668 time to create 1 rle with old method : 0.014604806900024414 time for calcul the mask position with numpy : 0.009508371353149414 nb_pixel_total : 23142 time to create 1 rle with old method : 0.02495098114013672 time for calcul the mask position with numpy : 0.00969243049621582 nb_pixel_total : 1726 time to create 1 rle with old method : 0.0017533302307128906 time for calcul the mask position with numpy : 0.009706258773803711 nb_pixel_total : 27162 time to create 1 rle with old method : 0.02920055389404297 time for calcul the mask position with numpy : 0.009243011474609375 nb_pixel_total : 12332 time to create 1 rle with old method : 0.013846874237060547 time for calcul the mask position with numpy : 0.009569168090820312 nb_pixel_total : 14857 time to create 1 rle with old method : 0.016308069229125977 time for calcul the mask position with numpy : 0.009243965148925781 nb_pixel_total : 34034 time to create 1 rle with old method : 0.034330129623413086 time for calcul the mask position with numpy : 0.008527278900146484 nb_pixel_total : 14683 time to create 1 rle with old method : 0.01596856117248535 time for calcul the mask position with numpy : 0.005987644195556641 nb_pixel_total : 24401 time to create 1 rle with old method : 0.024960756301879883 time for calcul the mask position with numpy : 0.00601506233215332 nb_pixel_total : 31225 time to create 1 rle with old method : 0.03159785270690918 time for calcul the mask position with numpy : 0.005814313888549805 nb_pixel_total : 2292 time to create 1 rle with old method : 0.0023186206817626953 time for calcul the mask position with numpy : 0.005857706069946289 nb_pixel_total : 8076 time to create 1 rle with old method : 0.008438348770141602 time for calcul the mask position with numpy : 0.005919933319091797 nb_pixel_total : 3123 time to create 1 rle with old method : 0.003324747085571289 time for calcul the mask position with numpy : 0.008272409439086914 nb_pixel_total : 2673 time to create 1 rle with old method : 0.004438161849975586 time for calcul the mask position with numpy : 0.00659632682800293 nb_pixel_total : 18937 time to create 1 rle with old method : 0.029871702194213867 time for calcul the mask position with numpy : 0.009930610656738281 nb_pixel_total : 17292 time to create 1 rle with old method : 0.027459144592285156 time for calcul the mask position with numpy : 0.008735179901123047 nb_pixel_total : 6533 time to create 1 rle with old method : 0.007169008255004883 time for calcul the mask position with numpy : 0.00844430923461914 nb_pixel_total : 6233 time to create 1 rle with old method : 0.006799936294555664 time for calcul the mask position with numpy : 0.008588552474975586 nb_pixel_total : 12676 time to create 1 rle with old method : 0.013872623443603516 time for calcul the mask position with numpy : 0.008592367172241211 nb_pixel_total : 6145 time to create 1 rle with old method : 0.00664830207824707 time for calcul the mask position with numpy : 0.00839853286743164 nb_pixel_total : 20813 time to create 1 rle with old method : 0.022145986557006836 time for calcul the mask position with numpy : 0.008228778839111328 nb_pixel_total : 14831 time to create 1 rle with old method : 0.015757322311401367 time for calcul the mask position with numpy : 0.008268117904663086 nb_pixel_total : 3409 time to create 1 rle with old method : 0.0036945343017578125 create new chi : 0.9935750961303711 time to delete rle : 0.0011358261108398438 batch 1 Loaded 61 chid ids of type : 4211 Number RLEs to save : 9907 TO DO : save crop sub photo not yet done ! save time : 1.3966689109802246 nb_obj : 15 nb_hashtags : 8 time to prepare the origin masks : 1.0450966358184814 time for calcul the mask position with numpy : 0.02695178985595703 nb_pixel_total : 1907920 time to create 1 rle with new method : 0.03856372833251953 time for calcul the mask position with numpy : 0.006617069244384766 nb_pixel_total : 4866 time to create 1 rle with old method : 0.005025386810302734 time for calcul the mask position with numpy : 0.007759571075439453 nb_pixel_total : 20056 time to create 1 rle with old method : 0.02091526985168457 time for calcul the mask position with numpy : 0.006403207778930664 nb_pixel_total : 1889 time to create 1 rle with old method : 0.00197601318359375 time for calcul the mask position with numpy : 0.006417751312255859 nb_pixel_total : 13117 time to create 1 rle with old method : 0.013379096984863281 time for calcul the mask position with numpy : 0.006587028503417969 nb_pixel_total : 9244 time to create 1 rle with old method : 0.009599685668945312 time for calcul the mask position with numpy : 0.006548881530761719 nb_pixel_total : 16452 time to create 1 rle with old method : 0.016218185424804688 time for calcul the mask position with numpy : 0.006539106369018555 nb_pixel_total : 2159 time to create 1 rle with old method : 0.0022068023681640625 time for calcul the mask position with numpy : 0.00650787353515625 nb_pixel_total : 16760 time to create 1 rle with old method : 0.01686382293701172 time for calcul the mask position with numpy : 0.007541179656982422 nb_pixel_total : 8028 time to create 1 rle with old method : 0.008095502853393555 time for calcul the mask position with numpy : 0.006945133209228516 nb_pixel_total : 12626 time to create 1 rle with old method : 0.012442588806152344 time for calcul the mask position with numpy : 0.006867647171020508 nb_pixel_total : 3053 time to create 1 rle with old method : 0.003082752227783203 time for calcul the mask position with numpy : 0.00749516487121582 nb_pixel_total : 5529 time to create 1 rle with old method : 0.005590915679931641 time for calcul the mask position with numpy : 0.006403446197509766 nb_pixel_total : 18852 time to create 1 rle with old method : 0.018920183181762695 time for calcul the mask position with numpy : 0.006527900695800781 nb_pixel_total : 14294 time to create 1 rle with old method : 0.01442575454711914 time for calcul the mask position with numpy : 0.006491184234619141 nb_pixel_total : 18755 time to create 1 rle with old method : 0.01882147789001465 create new chi : 0.33580827713012695 time to delete rle : 0.0005917549133300781 batch 1 Loaded 31 chid ids of type : 4211 Number RLEs to save : 4980 TO DO : save crop sub photo not yet done ! save time : 0.979794979095459 map_output_result : {1330277594: (0.0, 'Should be the crop_list due to order', 0.0), 1330277570: (0.0, 'Should be the crop_list due to order', 0.0), 1330277567: (0.0, 'Should be the crop_list due to order', 0.0), 1330277562: (0.0, 'Should be the crop_list due to order', 0.0), 1330277446: (0.0, 'Should be the crop_list due to order', 0.0), 1330277412: (0.0, 'Should be the crop_list due to order', 0.0), 1330277381: (0.0, 'Should be the crop_list due to order', 0.0), 1330277375: (0.0, 'Should be the crop_list due to order', 0.0), 1330277371: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1330277594, 1330277570, 1330277567, 1330277562, 1330277446, 1330277412, 1330277381, 1330277375, 1330277371] Looping around the photos to save general results len do output : 9 /1330277594.Didn't retrieve data . /1330277570.Didn't retrieve data . /1330277567.Didn't retrieve data . /1330277562.Didn't retrieve data . /1330277446.Didn't retrieve data . /1330277412.Didn't retrieve data . /1330277381.Didn't retrieve data . /1330277375.Didn't retrieve data . /1330277371.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277594', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277570', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277567', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277562', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277446', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277412', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277381', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277375', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277371', None, None, None, None, None, '2533516') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.021652936935424805 save_final save missing photos in datou_result : time spend for datou_step_exec : 38.79637575149536 time spend to save output : 0.022182226181030273 total time spend for step 8 : 38.81855797767639 step9:crop_condition Sat Feb 1 05:08:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4211 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 399 chid ids of type : 4211 begin to crop the class : barquette_opaque param for this class : {'min_score': 0.5} filtre for class : barquette_opaque hashtag_id of this class : 2107760128 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 34 About to insert : list_path_to_insert length 34 new photo from crops ! About to upload 34 photos upload in portfolio : 4869462 init cache_photo without model_param we have 34 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738382900_3255083 we have uploaded 34 photos in the portfolio 4869462 time of upload the photos Elapsed time : 11.60943341255188 we have finished the crop for the class : barquette_opaque begin to crop the class : carton param for this class : {'min_score': 0.5} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 4869462 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738382912_3255083 we have uploaded 3 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.1333940029144287 we have finished the crop for the class : carton begin to crop the class : ela param for this class : {'min_score': 0.5} filtre for class : ela hashtag_id of this class : 492741797 begin to crop the class : environnement param for this class : {'min_score': 0.5} filtre for class : environnement hashtag_id of this class : 493012381 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738382913_3255083 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.6007843017578125 we have finished the crop for the class : environnement begin to crop the class : etiquette param for this class : {'min_score': 0.5} filtre for class : etiquette hashtag_id of this class : 492636447 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 37 About to insert : list_path_to_insert length 37 new photo from crops ! About to upload 37 photos upload in portfolio : 4869462 init cache_photo without model_param we have 37 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738382915_3255083 we have uploaded 37 photos in the portfolio 4869462 time of upload the photos Elapsed time : 8.616349458694458 we have finished the crop for the class : etiquette begin to crop the class : film_plastique param for this class : {'min_score': 0.5} filtre for class : film_plastique hashtag_id of this class : 2107756122 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 4869462 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738382925_3255083 we have uploaded 8 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.3603713512420654 we have finished the crop for the class : film_plastique begin to crop the class : kraft param for this class : {'min_score': 0.5} filtre for class : kraft hashtag_id of this class : 493202403 begin to crop the class : metal param for this class : {'min_score': 0.5} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 4869462 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738382929_3255083 we have uploaded 12 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.744849443435669 we have finished the crop for the class : metal begin to crop the class : pehd param for this class : {'min_score': 0.5} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 4869462 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738382990_3255083 we have uploaded 9 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.7636427879333496 we have finished the crop for the class : pehd begin to crop the class : pet_clair param for this class : {'min_score': 0.5} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738382995_3255083 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.7947559356689453 we have finished the crop for the class : pet_clair begin to crop the class : pet_opaque param for this class : {'min_score': 0.5} filtre for class : pet_opaque hashtag_id of this class : 2107759152 Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 4869462 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738382997_3255083 we have uploaded 5 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.6054344177246094 we have finished the crop for the class : pet_opaque begin to crop the class : textiles_sanitaires param for this class : {'min_score': 0.5} filtre for class : textiles_sanitaires hashtag_id of this class : 2107760129 begin to crop the class : pet_fonce param for this class : {'min_score': 0.5} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 4869462 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738382999_3255083 we have uploaded 3 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.8523557186126709 we have finished the crop for the class : pet_fonce begin to crop the class : papier param for this class : {'min_score': 0.5} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 27 About to insert : list_path_to_insert length 27 new photo from crops ! About to upload 27 photos upload in portfolio : 4869462 init cache_photo without model_param we have 27 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738383003_3255083 we have uploaded 27 photos in the portfolio 4869462 time of upload the photos Elapsed time : 8.242708206176758 we have finished the crop for the class : papier delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1330277594, 1330277570, 1330277567, 1330277562, 1330277446, 1330277412, 1330277381, 1330277375, 1330277371] Looping around the photos to save general results len do output : 140 /1333601365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333601589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333602380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277594', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277570', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277567', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277562', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277446', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277412', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277381', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277375', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277371', None, None, None, None, None, '2533516') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 429 time used for this insertion : 0.480410099029541 save_final save missing photos in datou_result : time spend for datou_step_exec : 114.31644058227539 time spend to save output : 0.483797550201416 total time spend for step 9 : 114.8002381324768 step10:ventilate_hashtags_in_portfolio Sat Feb 1 05:10:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 19767139 get user id for portfolio 19767139 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19767139 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('etiquette','mal_croppe','ela','metal','papier','pet_fonce','film_plastique','pet_clair','pet_opaque','carton','barquette_opaque','pehd','flou','environnement','textiles_sanitaires','kraft')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19767139 AND mptpi.`type`=4211 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('etiquette','mal_croppe','ela','metal','papier','pet_fonce','film_plastique','pet_clair','pet_opaque','carton','barquette_opaque','pehd','flou','environnement','textiles_sanitaires','kraft')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/19784547,19784548,19784549,19784550,19784551,19784552,19784553,19784554,19784555,19784556,19784557,19784558,19784559,19784560,19784561,19784562?tags=barquette_opaque,papier,pet_opaque,textiles_sanitaires,flou,ela,carton,etiquette,pet_clair,environnement,pet_fonce,mal_croppe,metal,kraft,film_plastique,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1330277594, 1330277570, 1330277567, 1330277562, 1330277446, 1330277412, 1330277381, 1330277375, 1330277371] Looping around the photos to save general results len do output : 1 /19767139. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277594', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277570', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277567', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277562', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277446', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277412', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277381', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277375', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277371', None, None, None, None, None, '2533516') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.016974449157714844 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.0464913845062256 time spend to save output : 0.01721477508544922 total time spend for step 10 : 2.063706159591675 step11:final Sat Feb 1 05:10:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1330277594: ('0.06411924501170407',), 1330277570: ('0.06411924501170407',), 1330277567: ('0.06411924501170407',), 1330277562: ('0.06411924501170407',), 1330277446: ('0.06411924501170407',), 1330277412: ('0.06411924501170407',), 1330277381: ('0.06411924501170407',), 1330277375: ('0.06411924501170407',), 1330277371: ('0.06411924501170407',)} new output for save of step final : {1330277594: ('0.06411924501170407',), 1330277570: ('0.06411924501170407',), 1330277567: ('0.06411924501170407',), 1330277562: ('0.06411924501170407',), 1330277446: ('0.06411924501170407',), 1330277412: ('0.06411924501170407',), 1330277381: ('0.06411924501170407',), 1330277375: ('0.06411924501170407',), 1330277371: ('0.06411924501170407',)} [1330277594, 1330277570, 1330277567, 1330277562, 1330277446, 1330277412, 1330277381, 1330277375, 1330277371] Looping around the photos to save general results len do output : 9 /1330277594.Didn't retrieve data . /1330277570.Didn't retrieve data . /1330277567.Didn't retrieve data . /1330277562.Didn't retrieve data . /1330277446.Didn't retrieve data . /1330277412.Didn't retrieve data . /1330277381.Didn't retrieve data . /1330277375.Didn't retrieve data . /1330277371.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277594', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277570', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277567', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277562', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277446', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277412', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277381', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277375', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277371', None, None, None, None, None, '2533516') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.01570415496826172 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10744404792785645 time spend to save output : 0.016156435012817383 total time spend for step 11 : 0.12360048294067383 step12:velours_tree Sat Feb 1 05:10:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.03597450256347656 time spend to save output : 3.0040740966796875e-05 total time spend for step 12 : 0.03600454330444336 step13:send_mail_cod Sat Feb 1 05:10:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P19767139_01-02-2025_05_10_14.pdf 19784547 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197845471738383014 19784548 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197845481738383015 19784549 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197845491738383015 19784550 imagette197845501738383016 19784551 imagette197845511738383016 19784552 imagette197845521738383016 19784553 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197845531738383016 19784554 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197845541738383016 19784555 change filename to text .change filename to text .change filename to text .change filename to text .imagette197845551738383017 19784557 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197845571738383018 19784558 imagette197845581738383018 19784559 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197845591738383018 19784560 imagette197845601738383019 19784561 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette197845611738383019 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=19767139 and hashtag_type = 4211 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/19784547,19784548,19784549,19784550,19784551,19784552,19784553,19784554,19784555,19784556,19784557,19784558,19784559,19784560,19784561,19784562?tags=barquette_opaque,papier,pet_opaque,textiles_sanitaires,flou,ela,carton,etiquette,pet_clair,environnement,pet_fonce,mal_croppe,metal,kraft,film_plastique,pehd your option no_mail is active, we will not send the real mail to your client args[1330277594] : ((1330277594, -3.259012971610857, 492609224), (1330277594, -0.2576821629915117, 496442774), '0.06411924501170407') We are sending mail with results at report@fotonower.com args[1330277570] : ((1330277570, -3.6486186899540316, 492609224), (1330277570, -0.21340190396600764, 496442774), '0.06411924501170407') We are sending mail with results at report@fotonower.com args[1330277567] : ((1330277567, -3.425525647270954, 492609224), (1330277567, -0.21190750041478246, 496442774), '0.06411924501170407') We are sending mail with results at report@fotonower.com args[1330277562] : ((1330277562, -2.900677668968439, 492609224), (1330277562, -0.1718188623055399, 496442774), '0.06411924501170407') We are sending mail with results at report@fotonower.com args[1330277446] : ((1330277446, -1.1366575134294805, 492688767), (1330277446, 0.37086904882138155, 2107752395), '0.06411924501170407') We are sending mail with results at report@fotonower.com args[1330277412] : ((1330277412, -2.674634706788132, 492609224), (1330277412, -0.20331323710273522, 496442774), '0.06411924501170407') We are sending mail with results at report@fotonower.com args[1330277381] : ((1330277381, -2.6019933223717993, 492609224), (1330277381, -0.0025816526345150276, 2107752395), '0.06411924501170407') We are sending mail with results at report@fotonower.com args[1330277375] : ((1330277375, -1.7964235288715087, 492688767), (1330277375, -0.19627580077917398, 496442774), '0.06411924501170407') We are sending mail with results at report@fotonower.com args[1330277371] : ((1330277371, -2.0661461864794903, 492609224), (1330277371, -0.16776473237450612, 496442774), '0.06411924501170407') We are sending mail with results at report@fotonower.com refus_total : 0.06411924501170407 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=19767139 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1330277786,1330277687,1330277371,1330277597,1330277791,1330277774,1330277721,1330277717,1330277701,1330277683,1330277641,1330277594,1330277570,1330277567,1330277562,1330277446,1330277412,1330277381,1330277375) Found this number of photos: 19 begin to download photo : 1330277786 begin to download photo : 1330277791 begin to download photo : 1330277701 begin to download photo : 1330277570 begin to download photo : 1330277412 download finish for photo 1330277786 begin to download photo : 1330277687 download finish for photo 1330277412 begin to download photo : 1330277381 download finish for photo 1330277701 begin to download photo : 1330277683 download finish for photo 1330277570 begin to download photo : 1330277567 download finish for photo 1330277791 begin to download photo : 1330277774 download finish for photo 1330277381 begin to download photo : 1330277375 download finish for photo 1330277687 begin to download photo : 1330277371 download finish for photo 1330277683 begin to download photo : 1330277641 download finish for photo 1330277774 begin to download photo : 1330277721 download finish for photo 1330277375 download finish for photo 1330277567 begin to download photo : 1330277562 download finish for photo 1330277641 begin to download photo : 1330277594 download finish for photo 1330277371 begin to download photo : 1330277597 download finish for photo 1330277721 begin to download photo : 1330277717 download finish for photo 1330277597 download finish for photo 1330277594 download finish for photo 1330277562 begin to download photo : 1330277446 download finish for photo 1330277717 download finish for photo 1330277446 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767139_01-02-2025_05_10_14.pdf results_Auto_P19767139_01-02-2025_05_10_14.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767139_01-02-2025_05_10_14.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4909','19767139','results_Auto_P19767139_01-02-2025_05_10_14.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767139_01-02-2025_05_10_14.pdf','pdf','','0.48','0.06411924501170407') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1330277594, 1330277570, 1330277567, 1330277562, 1330277446, 1330277412, 1330277381, 1330277375, 1330277371] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277594', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277570', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277567', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277562', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277446', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277412', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277381', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277375', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277371', None, None, None, None, None, '2533516') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.015039682388305664 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.931385040283203 time spend to save output : 0.015355348587036133 total time spend for step 13 : 8.94674038887024 step14:split_time_score Sat Feb 1 05:10:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 19),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 20012025 19767139 Nombre de photos uploadées : 19 / 23040 (0%) 20012025 19767139 Nombre de photos taguées (types de déchets): 0 / 19 (0%) 20012025 19767139 Nombre de photos taguées (volume) : 0 / 19 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ??????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0009448528289794922 elapsed_time : insert_dashboard_record_day_entry 0.024591445922851562 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.05368542655064632 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19756680_20-01-2025_15_42_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19756680 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19756680 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19758113_24-01-2025_03_37_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19758113 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19759715_21-01-2025_11_22_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19759715 order by id desc limit 1 Qualite : 0.06918528095839836 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19759717_20-01-2025_16_35_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19759717 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19759717 AND mptpi.`type`=4207 To do Qualite : 0.15889673840838808 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19760921_21-01-2025_02_16_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19760921 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19760921 AND mptpi.`type`=3327 To do Qualite : 0.06950101375332633 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19760922_20-01-2025_17_21_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19760922 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19760922 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19762317_21-01-2025_13_06_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19762317 order by id desc limit 1 Qualite : 0.12856035913273142 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19762319_21-01-2025_02_30_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19762319 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19762319 AND mptpi.`type`=3327 To do Qualite : 0.050119454659034675 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19764097_20-01-2025_19_04_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19764097 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19764097 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19764099_21-01-2025_14_11_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19764099 order by id desc limit 1 Qualite : 0.0786938007210795 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19764105_20-01-2025_18_54_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19764105 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19764105 AND mptpi.`type`=4207 To do Qualite : 0.03603286478179441 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767139_01-02-2025_05_10_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767139 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19767139 AND mptpi.`type`=4211 To do Qualite : 0.0 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767140_21-01-2025_04_23_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767140 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19767140 AND mptpi.`type`=4209 To do Qualite : 0.06752219012654 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767141_20-01-2025_19_53_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767141 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19767141 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767142_22-01-2025_08_47_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767142 order by id desc limit 1 Qualite : 0.0927947099350885 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767143_21-01-2025_02_39_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767143 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19767143 AND mptpi.`type`=3327 To do Qualite : 0.03400019813689533 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767144_21-01-2025_04_33_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767144 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19767144 AND mptpi.`type`=4205 To do Qualite : 0.06198034924246159 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19767145_20-01-2025_19_46_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19767145 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19767145 AND mptpi.`type`=4207 To do Qualite : 0.07309230429021216 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19768584_21-01-2025_02_07_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19768584 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19768584 AND mptpi.`type`=3327 To do Qualite : 0.05940739517148176 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19768589_20-01-2025_20_14_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19768589 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19768589 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19770008_21-01-2025_06_04_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19770008 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19770010_22-01-2025_09_13_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19770010 order by id desc limit 1 Qualite : 0.045333373431294996 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19770011_20-01-2025_21_18_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19770011 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19770011 AND mptpi.`type`=4207 To do Qualite : 0.08460401115881525 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19770012_21-01-2025_01_51_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19770012 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19770012 AND mptpi.`type`=3327 To do Qualite : 0.038192458824297226 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19772060_01-02-2025_05_02_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19772060 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19772060 AND mptpi.`type`=4211 To do Qualite : 0.05919716841688413 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19772062_20-01-2025_21_46_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19772062 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19772062 AND mptpi.`type`=4207 To do Qualite : 0.05021197427524266 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19773068_22-01-2025_17_53_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19773068 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19773068 AND mptpi.`type`=4203 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19773069_22-01-2025_16_13_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19773069 order by id desc limit 1 Qualite : 0.09343093275297072 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19773070_20-01-2025_23_18_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19773070 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19773070 AND mptpi.`type`=3327 To do Qualite : 0.05267148959863112 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19773071_01-02-2025_04_12_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19773071 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19773071 AND mptpi.`type`=4211 To do Qualite : 0.06740297704934484 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19774194_20-01-2025_22_43_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19774194 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19774194 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777200_22-01-2025_18_48_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777200 order by id desc limit 1 Qualite : 0.05421734473668348 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777201_21-01-2025_01_27_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777201 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777201 AND mptpi.`type`=3327 To do Qualite : 0.044092539373829086 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777202_21-01-2025_00_21_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777202 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777202 AND mptpi.`type`=4207 To do Qualite : 0.04190112060013058 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777203_01-02-2025_02_38_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777203 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777203 AND mptpi.`type`=4211 To do Qualite : 0.048840458590288995 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777205_21-01-2025_00_13_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777205 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777205 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777206_24-01-2025_03_16_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777206 order by id desc limit 1 Qualite : 0.09987592641146087 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777207_21-01-2025_00_56_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777207 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777207 AND mptpi.`type`=3327 To do Qualite : 0.0 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777208_21-01-2025_12_02_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777208 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777208 AND mptpi.`type`=4209 To do Qualite : 0.03332046749521877 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P19777209_01-02-2025_03_30_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 19777209 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13953 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13961 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13960 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13957 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13957 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13966 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13959 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13954 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13964 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13964 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13956 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13955 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13955 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13963 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13956 doesn't seem to be define in the database( WARNING : type of input 3 of step 13955 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13953 doesn't seem to be define in the database( WARNING : type of input 2 of step 13957 doesn't seem to be define in the database( WARNING : output 1 of step 13953 have datatype=2 whereas input 1 of step 13959 have datatype=7 WARNING : type of output 2 of step 13959 doesn't seem to be define in the database( WARNING : type of input 1 of step 13954 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13956 have datatype=10 whereas input 3 of step 13962 have datatype=6 WARNING : type of input 2 of step 13964 doesn't seem to be define in the database( WARNING : output 1 of step 13954 have datatype=7 whereas input 2 of step 13964 have datatype=None WARNING : type of output 3 of step 13964 doesn't seem to be define in the database( WARNING : type of input 1 of step 13956 doesn't seem to be define in the database( WARNING : output 0 of step 13956 have datatype=10 whereas input 0 of step 13965 have datatype=18 WARNING : type of input 5 of step 13962 doesn't seem to be define in the database( WARNING : output 0 of step 13965 have datatype=11 whereas input 5 of step 13962 have datatype=None WARNING : type of output 1 of step 13961 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : type of output 1 of step 13960 doesn't seem to be define in the database( WARNING : type of input 3 of step 13957 doesn't seem to be define in the database( WARNING : output 0 of step 13959 have datatype=1 whereas input 0 of step 13954 have datatype=2 WARNING : output 0 of step 13966 have datatype=6 whereas input 2 of step 13959 have datatype=5 WARNING : output 0 of step 13953 have datatype=16 whereas input 0 of step 13959 have datatype=1 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=19777209 AND mptpi.`type`=4211 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'20012025': {'nb_upload': 19, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1330277594, 1330277570, 1330277567, 1330277562, 1330277446, 1330277412, 1330277381, 1330277375, 1330277371] Looping around the photos to save general results len do output : 1 /19767139Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277594', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277570', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277567', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277562', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277446', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277412', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277381', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277375', None, None, None, None, None, '2533516') ('4909', None, None, None, None, None, None, None, '2533516') ('4909', None, '1330277371', None, None, None, None, None, '2533516') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.015556573867797852 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.0354368686676025 time spend to save output : 0.01597285270690918 total time spend for step 14 : 6.051409721374512 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 146.70user 40.27system 6:04.06elapsed 51%CPU (0avgtext+0avgdata 4068928maxresident)k 501984inputs+173488outputs (100major+5473306minor)pagefaults 0swaps