python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 3459 -l 10 ' -s datou_current_3459 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 499432 load datou : 3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? id de la photo (peut être local ou global) was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? id de la photo (peut être local ou global) was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (4999, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 16384, 25088, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'res5b', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2020, 10, 23, 14, 27, 22), datetime.datetime(2020, 10, 23, 14, 27, 22)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5288, 'learn_papier_nantes_300421', 512, 512, 'learn_papier_nantes_300421', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 30, 17, 9, 41), datetime.datetime(2021, 4, 30, 17, 9, 41)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5309, 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 16384, 25088, 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 5, 10, 19, 20, 46), datetime.datetime(2021, 5, 10, 19, 20, 46)) load thcls load THCL from format json or kwargs add thcl : 2456 in CacheModelConfig load THCL from format json or kwargs add thcl : 2868 in CacheModelConfig load THCL from format json or kwargs add thcl : 2896 in CacheModelConfig load pdts add pdt : 4999 in CacheModelConfig add pdt : 5288 in CacheModelConfig add pdt : 5309 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 22>10 please execute split_portfolio.py -i 21159305 -l 10 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 3459, datou_cur_ids : ['2649742'] with mtr_portfolio_ids : ['21159305'] and first list_photo_ids : [] new path : /proc/499432/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, thcl, merge_mask_thcl_custom, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 1.5084424018859863 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Fri Mar 7 20:52:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10593 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-07 20:52:32.754475: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-07 20:52:32.779076: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-07 20:52:32.780708: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f643c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-07 20:52:32.780762: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-07 20:52:32.783333: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-07 20:52:32.926695: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x29013dd0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-07 20:52:32.926726: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-07 20:52:32.927637: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-07 20:52:32.927930: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 20:52:32.929965: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 20:52:32.932115: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-07 20:52:32.932447: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-07 20:52:32.938733: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-07 20:52:32.940006: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-07 20:52:32.945790: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-07 20:52:32.947257: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-07 20:52:32.947350: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 20:52:32.948135: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-07 20:52:32.948150: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-07 20:52:32.948159: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-07 20:52:32.949443: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9815 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-07 20:52:33.202608: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-07 20:52:33.202733: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 20:52:33.202749: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 20:52:33.202764: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-07 20:52:33.202777: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-07 20:52:33.202791: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-07 20:52:33.202804: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-07 20:52:33.202818: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-07 20:52:33.204001: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-07 20:52:33.205077: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-07 20:52:33.205105: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 20:52:33.205119: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 20:52:33.205131: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-07 20:52:33.205144: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-07 20:52:33.205156: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-07 20:52:33.205168: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-07 20:52:33.205181: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-07 20:52:33.206328: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-07 20:52:33.206360: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-07 20:52:33.206368: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-07 20:52:33.206375: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-07 20:52:33.207581: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9815 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2896 thcls : [{'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5309 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5309, 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 16384, 25088, 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 5, 10, 19, 20, 46), datetime.datetime(2021, 5, 10, 19, 20, 46)) {'thcl': {'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'carton_brun', 'carton_gris', 'cartonnette', 'kraft', 'autre_refus', 'metal', 'plastique', 'teint_dans_la_masse', 'environnement'], 'list_hashtags_csv': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'svm_hashtag_type_desc': 5309, 'photo_desc_type': 5309, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'carton_brun', 'carton_gris', 'cartonnette', 'kraft', 'autre_refus', 'metal', 'plastique', 'teint_dans_la_masse', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_convoyeur_qualipapia_nantes_poly_100521_1 NUM_CLASSES 10 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_convoyeur_qualipapia_nantes_poly_100521_1 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-07 20:52:43.798738: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 20:52:43.982910: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_convoyeur_qualipapia_nantes_poly_100521_1 /data/models_weight/learn_convoyeur_qualipapia_nantes_poly_100521_1/mask_model.h5 size_local : 256031040 size in s3 : 256031040 create time local : 2021-08-09 05:45:48 create time in s3 : 2021-08-06 18:59:51 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.79293 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 3264.00000 nb d'objets trouves : 6 Detection mask done ! Trying to reset tf kernel 499955 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5304 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10593 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2896 Catched exception ! Connect or reconnect ! thcls : [{'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5309 ['background', 'carton_brun', 'carton_gris', 'cartonnette', 'kraft', 'autre_refus', 'metal', 'plastique', 'teint_dans_la_masse', 'environnement'] time for calcul the mask position with numpy : 0.0031316280364990234 nb_pixel_total : 112395 time to create 1 rle with old method : 0.14334940910339355 length of segment : 863 time for calcul the mask position with numpy : 2.07991361618042 nb_pixel_total : 4596870 time to create 1 rle with new method : 0.7294387817382812 length of segment : 2920 time for calcul the mask position with numpy : 0.0012547969818115234 nb_pixel_total : 108860 time to create 1 rle with old method : 0.12807440757751465 length of segment : 427 time for calcul the mask position with numpy : 0.0008544921875 nb_pixel_total : 40768 time to create 1 rle with old method : 0.05118513107299805 length of segment : 721 time for calcul the mask position with numpy : 0.0007951259613037109 nb_pixel_total : 46287 time to create 1 rle with old method : 0.05382132530212402 length of segment : 372 time for calcul the mask position with numpy : 0.0004017353057861328 nb_pixel_total : 27925 time to create 1 rle with old method : 0.033537864685058594 length of segment : 193 time for calcul the mask position with numpy : 0.0011348724365234375 nb_pixel_total : 75736 time to create 1 rle with old method : 0.10029292106628418 length of segment : 324 time for calcul the mask position with numpy : 0.0009827613830566406 nb_pixel_total : 48732 time to create 1 rle with old method : 0.05904388427734375 length of segment : 445 time for calcul the mask position with numpy : 0.000293731689453125 nb_pixel_total : 11673 time to create 1 rle with old method : 0.014317750930786133 length of segment : 161 time for calcul the mask position with numpy : 0.0009310245513916016 nb_pixel_total : 56366 time to create 1 rle with old method : 0.06525230407714844 length of segment : 290 time for calcul the mask position with numpy : 0.0007960796356201172 nb_pixel_total : 33987 time to create 1 rle with old method : 0.039548635482788086 length of segment : 369 time for calcul the mask position with numpy : 0.0006825923919677734 nb_pixel_total : 35262 time to create 1 rle with old method : 0.04019474983215332 length of segment : 240 time for calcul the mask position with numpy : 0.00024390220642089844 nb_pixel_total : 11324 time to create 1 rle with old method : 0.014737606048583984 length of segment : 96 time for calcul the mask position with numpy : 0.0007007122039794922 nb_pixel_total : 39538 time to create 1 rle with old method : 0.04497981071472168 length of segment : 342 time for calcul the mask position with numpy : 0.0002384185791015625 nb_pixel_total : 10267 time to create 1 rle with old method : 0.011719703674316406 length of segment : 128 time for calcul the mask position with numpy : 0.00024271011352539062 nb_pixel_total : 10653 time to create 1 rle with old method : 0.012826204299926758 length of segment : 186 time for calcul the mask position with numpy : 0.004019498825073242 nb_pixel_total : 243106 time to create 1 rle with new method : 0.014693260192871094 length of segment : 687 time for calcul the mask position with numpy : 0.0014786720275878906 nb_pixel_total : 93313 time to create 1 rle with old method : 0.11664938926696777 length of segment : 280 time for calcul the mask position with numpy : 0.0019254684448242188 nb_pixel_total : 39774 time to create 1 rle with old method : 0.04736042022705078 length of segment : 358 time for calcul the mask position with numpy : 0.003659963607788086 nb_pixel_total : 109514 time to create 1 rle with old method : 0.12161684036254883 length of segment : 414 time for calcul the mask position with numpy : 0.0025658607482910156 nb_pixel_total : 67175 time to create 1 rle with old method : 0.0825490951538086 length of segment : 321 time for calcul the mask position with numpy : 0.00042128562927246094 nb_pixel_total : 6405 time to create 1 rle with old method : 0.008392095565795898 length of segment : 81 time for calcul the mask position with numpy : 0.008266448974609375 nb_pixel_total : 248609 time to create 1 rle with new method : 0.011593818664550781 length of segment : 558 time for calcul the mask position with numpy : 0.0009853839874267578 nb_pixel_total : 73674 time to create 1 rle with old method : 0.0826880931854248 length of segment : 315 time for calcul the mask position with numpy : 0.00043082237243652344 nb_pixel_total : 12625 time to create 1 rle with old method : 0.015208244323730469 length of segment : 127 time for calcul the mask position with numpy : 0.0048754215240478516 nb_pixel_total : 173762 time to create 1 rle with new method : 0.007848739624023438 length of segment : 600 time for calcul the mask position with numpy : 0.0011332035064697266 nb_pixel_total : 21827 time to create 1 rle with old method : 0.026968955993652344 length of segment : 156 time for calcul the mask position with numpy : 0.0003345012664794922 nb_pixel_total : 8251 time to create 1 rle with old method : 0.009756326675415039 length of segment : 139 time for calcul the mask position with numpy : 0.0006568431854248047 nb_pixel_total : 14096 time to create 1 rle with old method : 0.01659226417541504 length of segment : 203 time for calcul the mask position with numpy : 0.0018460750579833984 nb_pixel_total : 59730 time to create 1 rle with old method : 0.07246279716491699 length of segment : 370 time for calcul the mask position with numpy : 0.005077838897705078 nb_pixel_total : 253056 time to create 1 rle with new method : 0.008384466171264648 length of segment : 763 time for calcul the mask position with numpy : 0.0016028881072998047 nb_pixel_total : 49221 time to create 1 rle with old method : 0.06083798408508301 length of segment : 287 time for calcul the mask position with numpy : 0.0033631324768066406 nb_pixel_total : 130600 time to create 1 rle with old method : 0.14378714561462402 length of segment : 488 time for calcul the mask position with numpy : 0.0038573741912841797 nb_pixel_total : 135769 time to create 1 rle with old method : 0.14996957778930664 length of segment : 500 time for calcul the mask position with numpy : 0.0007736682891845703 nb_pixel_total : 25718 time to create 1 rle with old method : 0.029334306716918945 length of segment : 267 time for calcul the mask position with numpy : 0.0007452964782714844 nb_pixel_total : 27602 time to create 1 rle with old method : 0.030985593795776367 length of segment : 196 time for calcul the mask position with numpy : 0.0002524852752685547 nb_pixel_total : 4984 time to create 1 rle with old method : 0.006288290023803711 length of segment : 131 time for calcul the mask position with numpy : 0.001695871353149414 nb_pixel_total : 39412 time to create 1 rle with old method : 0.04349470138549805 length of segment : 471 time for calcul the mask position with numpy : 0.00197601318359375 nb_pixel_total : 129279 time to create 1 rle with old method : 0.13988709449768066 length of segment : 473 time for calcul the mask position with numpy : 0.0006856918334960938 nb_pixel_total : 18362 time to create 1 rle with old method : 0.020941972732543945 length of segment : 177 time for calcul the mask position with numpy : 0.00040078163146972656 nb_pixel_total : 12677 time to create 1 rle with old method : 0.015344619750976562 length of segment : 115 time for calcul the mask position with numpy : 0.0020797252655029297 nb_pixel_total : 88825 time to create 1 rle with old method : 0.09645771980285645 length of segment : 354 time for calcul the mask position with numpy : 0.0009338855743408203 nb_pixel_total : 11288 time to create 1 rle with old method : 0.013564109802246094 length of segment : 233 time for calcul the mask position with numpy : 0.0013892650604248047 nb_pixel_total : 51332 time to create 1 rle with old method : 0.05823159217834473 length of segment : 355 time for calcul the mask position with numpy : 0.0011343955993652344 nb_pixel_total : 43238 time to create 1 rle with old method : 0.04934215545654297 length of segment : 170 time for calcul the mask position with numpy : 0.00017023086547851562 nb_pixel_total : 3880 time to create 1 rle with old method : 0.004964113235473633 length of segment : 68 time for calcul the mask position with numpy : 0.00416254997253418 nb_pixel_total : 109108 time to create 1 rle with old method : 0.12138724327087402 length of segment : 719 time for calcul the mask position with numpy : 0.00013113021850585938 nb_pixel_total : 4538 time to create 1 rle with old method : 0.0058095455169677734 length of segment : 77 time for calcul the mask position with numpy : 0.006723642349243164 nb_pixel_total : 332627 time to create 1 rle with new method : 0.01602029800415039 length of segment : 941 time for calcul the mask position with numpy : 0.0012378692626953125 nb_pixel_total : 38787 time to create 1 rle with old method : 0.04579448699951172 length of segment : 294 time for calcul the mask position with numpy : 0.0014078617095947266 nb_pixel_total : 74741 time to create 1 rle with old method : 0.11112260818481445 length of segment : 502 time for calcul the mask position with numpy : 0.0010116100311279297 nb_pixel_total : 14607 time to create 1 rle with old method : 0.018033742904663086 length of segment : 177 time for calcul the mask position with numpy : 0.002239227294921875 nb_pixel_total : 101745 time to create 1 rle with old method : 0.14085817337036133 length of segment : 491 time for calcul the mask position with numpy : 0.0007016658782958984 nb_pixel_total : 23961 time to create 1 rle with old method : 0.027992725372314453 length of segment : 165 time for calcul the mask position with numpy : 0.0003871917724609375 nb_pixel_total : 19194 time to create 1 rle with old method : 0.02287149429321289 length of segment : 158 time for calcul the mask position with numpy : 0.0011742115020751953 nb_pixel_total : 52962 time to create 1 rle with old method : 0.06466937065124512 length of segment : 324 time for calcul the mask position with numpy : 0.0008437633514404297 nb_pixel_total : 28413 time to create 1 rle with old method : 0.035567283630371094 length of segment : 355 time for calcul the mask position with numpy : 0.0010008811950683594 nb_pixel_total : 23793 time to create 1 rle with old method : 0.028339385986328125 length of segment : 206 time for calcul the mask position with numpy : 0.0007350444793701172 nb_pixel_total : 17973 time to create 1 rle with old method : 0.020386219024658203 length of segment : 251 time for calcul the mask position with numpy : 0.006845712661743164 nb_pixel_total : 253978 time to create 1 rle with new method : 0.017609834671020508 length of segment : 737 time for calcul the mask position with numpy : 0.00022292137145996094 nb_pixel_total : 5428 time to create 1 rle with old method : 0.006735324859619141 length of segment : 59 time for calcul the mask position with numpy : 0.0001685619354248047 nb_pixel_total : 4588 time to create 1 rle with old method : 0.005789041519165039 length of segment : 50 time for calcul the mask position with numpy : 0.0004534721374511719 nb_pixel_total : 13375 time to create 1 rle with old method : 0.016447782516479492 length of segment : 183 time for calcul the mask position with numpy : 0.002190828323364258 nb_pixel_total : 129582 time to create 1 rle with old method : 0.14093446731567383 length of segment : 491 time for calcul the mask position with numpy : 0.0032987594604492188 nb_pixel_total : 204864 time to create 1 rle with new method : 0.005986690521240234 length of segment : 522 time for calcul the mask position with numpy : 0.001993894577026367 nb_pixel_total : 105647 time to create 1 rle with old method : 0.1227562427520752 length of segment : 492 time for calcul the mask position with numpy : 0.0036041736602783203 nb_pixel_total : 128191 time to create 1 rle with old method : 0.1419069766998291 length of segment : 554 time for calcul the mask position with numpy : 0.0041387081146240234 nb_pixel_total : 106008 time to create 1 rle with old method : 0.13776946067810059 length of segment : 455 time for calcul the mask position with numpy : 0.0022847652435302734 nb_pixel_total : 51660 time to create 1 rle with old method : 0.05922102928161621 length of segment : 370 time for calcul the mask position with numpy : 0.001264810562133789 nb_pixel_total : 45327 time to create 1 rle with old method : 0.05228757858276367 length of segment : 238 time for calcul the mask position with numpy : 0.0013918876647949219 nb_pixel_total : 36798 time to create 1 rle with old method : 0.04569816589355469 length of segment : 285 time for calcul the mask position with numpy : 0.0017952919006347656 nb_pixel_total : 57138 time to create 1 rle with old method : 0.0635828971862793 length of segment : 310 time for calcul the mask position with numpy : 0.004363536834716797 nb_pixel_total : 63336 time to create 1 rle with old method : 0.07378292083740234 length of segment : 724 time for calcul the mask position with numpy : 0.0009431838989257812 nb_pixel_total : 27495 time to create 1 rle with old method : 0.03341841697692871 length of segment : 186 time for calcul the mask position with numpy : 0.0010313987731933594 nb_pixel_total : 20992 time to create 1 rle with old method : 0.024141788482666016 length of segment : 259 time for calcul the mask position with numpy : 0.005720615386962891 nb_pixel_total : 147620 time to create 1 rle with old method : 0.16025757789611816 length of segment : 656 time for calcul the mask position with numpy : 0.001132965087890625 nb_pixel_total : 29276 time to create 1 rle with old method : 0.031806230545043945 length of segment : 310 time for calcul the mask position with numpy : 0.00022912025451660156 nb_pixel_total : 4687 time to create 1 rle with old method : 0.005976438522338867 length of segment : 90 time for calcul the mask position with numpy : 0.002337217330932617 nb_pixel_total : 97066 time to create 1 rle with old method : 0.10809946060180664 length of segment : 299 time for calcul the mask position with numpy : 0.0005252361297607422 nb_pixel_total : 7930 time to create 1 rle with old method : 0.010053396224975586 length of segment : 148 time for calcul the mask position with numpy : 0.00014090538024902344 nb_pixel_total : 2257 time to create 1 rle with old method : 0.002782106399536133 length of segment : 76 time for calcul the mask position with numpy : 0.0008742809295654297 nb_pixel_total : 33577 time to create 1 rle with old method : 0.04550290107727051 length of segment : 310 time for calcul the mask position with numpy : 0.002518177032470703 nb_pixel_total : 106247 time to create 1 rle with old method : 0.12302827835083008 length of segment : 443 time for calcul the mask position with numpy : 0.00039839744567871094 nb_pixel_total : 5689 time to create 1 rle with old method : 0.0075075626373291016 length of segment : 125 time for calcul the mask position with numpy : 0.002360820770263672 nb_pixel_total : 77626 time to create 1 rle with old method : 0.08995580673217773 length of segment : 427 time for calcul the mask position with numpy : 0.0009255409240722656 nb_pixel_total : 26986 time to create 1 rle with old method : 0.031168699264526367 length of segment : 346 time for calcul the mask position with numpy : 0.002642393112182617 nb_pixel_total : 127762 time to create 1 rle with old method : 0.1425952911376953 length of segment : 604 time for calcul the mask position with numpy : 0.00032591819763183594 nb_pixel_total : 5171 time to create 1 rle with old method : 0.009345531463623047 length of segment : 128 time for calcul the mask position with numpy : 0.0005223751068115234 nb_pixel_total : 9098 time to create 1 rle with old method : 0.012746334075927734 length of segment : 105 time for calcul the mask position with numpy : 0.0021200180053710938 nb_pixel_total : 132417 time to create 1 rle with old method : 0.15485906600952148 length of segment : 328 time for calcul the mask position with numpy : 0.00027942657470703125 nb_pixel_total : 3777 time to create 1 rle with old method : 0.00670933723449707 length of segment : 68 time for calcul the mask position with numpy : 0.0017933845520019531 nb_pixel_total : 35945 time to create 1 rle with old method : 0.04206418991088867 length of segment : 427 time for calcul the mask position with numpy : 0.0003192424774169922 nb_pixel_total : 7079 time to create 1 rle with old method : 0.008762598037719727 length of segment : 105 time for calcul the mask position with numpy : 0.006093740463256836 nb_pixel_total : 96031 time to create 1 rle with old method : 0.1107478141784668 length of segment : 926 time for calcul the mask position with numpy : 0.00028896331787109375 nb_pixel_total : 3938 time to create 1 rle with old method : 0.004944324493408203 length of segment : 120 time for calcul the mask position with numpy : 0.0027353763580322266 nb_pixel_total : 104266 time to create 1 rle with old method : 0.11969733238220215 length of segment : 300 time for calcul the mask position with numpy : 0.004616975784301758 nb_pixel_total : 114236 time to create 1 rle with old method : 0.1257343292236328 length of segment : 484 time for calcul the mask position with numpy : 0.0012726783752441406 nb_pixel_total : 35509 time to create 1 rle with old method : 0.04098320007324219 length of segment : 189 time for calcul the mask position with numpy : 0.0002644062042236328 nb_pixel_total : 2329 time to create 1 rle with old method : 0.0029795169830322266 length of segment : 75 time for calcul the mask position with numpy : 0.010232925415039062 nb_pixel_total : 223793 time to create 1 rle with new method : 0.013908147811889648 length of segment : 998 time for calcul the mask position with numpy : 0.006381988525390625 nb_pixel_total : 131388 time to create 1 rle with old method : 0.14718031883239746 length of segment : 782 time for calcul the mask position with numpy : 0.005767345428466797 nb_pixel_total : 151267 time to create 1 rle with new method : 0.009185075759887695 length of segment : 657 time for calcul the mask position with numpy : 0.002115964889526367 nb_pixel_total : 68272 time to create 1 rle with old method : 0.07983613014221191 length of segment : 462 time for calcul the mask position with numpy : 0.0008645057678222656 nb_pixel_total : 24535 time to create 1 rle with old method : 0.027749061584472656 length of segment : 201 time for calcul the mask position with numpy : 0.00026988983154296875 nb_pixel_total : 4976 time to create 1 rle with old method : 0.00627446174621582 length of segment : 90 time for calcul the mask position with numpy : 0.0018312931060791016 nb_pixel_total : 60754 time to create 1 rle with old method : 0.07198309898376465 length of segment : 355 time for calcul the mask position with numpy : 0.00019$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC$œ’m…Îmo“LÒDüÜ;˜%gÏ?wêÁÅ·øîùovH0õÉa‡5£Ú*î Ø’ÃÌlÍ››S iyä”rÕO7ª“ž�%L]Ý×%±ºÇhk¶«·÷>v1­HB£®±ßÞÚd\�(e oIx¢>3´6BS%ÌØá“( œÛf$Ãhýé ¿¶åeÔŽôÚèHœ�‚`ݶ f{�Fo©Yò¿Ôó@00uMb’z-ëìXI$&ÂgfÖú¶7Ó´Þu|'K.ÌoP PÝÀùFË.Ðýoûò9B<~.’ïÅË[’´˜Ë<Ù­„$¯•¢·ä{1¹A�•.òbKxºL �¯�Ý·'¯u8n5 ’ºe,]ñH©–’ÆV¨ŒWwÃ$ùCƒel¹“|zys«™KŠi-ðqÊݬbk,wnGÿâ;¥ ~ ÖeÉrÍ’‰ÜÔ~' 1`V⦫¹-*[ÉñLÔKÄ'2@ŸÜþÐ仪 ²n‘Íß2¸N߈ƶµG•¢ói/U¢µ'Eï@¦`H湘;J•�¼¼ÜŽÅ +Jén#»¼‚6Ú´—ĹG•ü¡NÒGð'—Z!öáí¸‰Wi�»NJ @óàšAûÜZ|ª[¨ï$q}i�Ò·µQbtTEC478088379 length of segment : 639 time for calcul the mask position with numpy : 0.0005543231964111328 nb_pixel_total : 11960 time to create 1 rle with old method : 0.01486349105834961 length of segment : 184 time for calcul the mask position with numpy : 0.0061566829681396484 nb_pixel_total : 231563 time to create 1 rle with new method : 0.014585494995117188 length of segment : 1106 time for calcul the mask position with numpy : 0.0009379386901855469 nb_pixel_total : 9307 time to create 1 rle with old method : 0.013483762741088867 length of segment : 117 time for calcul the mask position with numpy : 0.001722574234008789 nb_pixel_total : 67736 time to create 1 rle with old method : 0.07593679428100586 length of segment : 494 time for calcul the mask position with numpy : 0.00022411346435546875 nb_pixel_total : 1919 time to create 1 rle with old method : 0.002699613571166992 length of segment : 67 time for calcul the mask position with numpy : 0.0011806488037109375 nb_pixel_total : 24683 time to create 1 rle with old method : 0.03053450584411621 length of segment : 239 time for calcul the mask position with numpy : 0.0037832260131835938 nb_pixel_total : 95410 time to create 1 rle with old method : 0.10669326782226562 length of segment : 871 time for calcul the mask position with numpy : 0.0015897750854492188 nb_pixel_total : 39002 time to create 1 rle with old method : 0.045815229415893555 length of segment : 248 time for calcul the mask position with numpy : 0.000354766845703125 nb_pixel_total : 3241 time to create 1 rle with old method : 0.004288434982299805 length of segment : 104 time for calcul the mask position with numpy : 0.002557516098022461 nb_pixel_total : 43345 time to create 1 rle with old method : 0.051805973052978516 length of segment : 432 time for calcul the mask position with numpy : 0.0005412101745605469 nb_pixel_total : 16740 time to create 1 rle with old method : 0.024225711822509766 length of segment : 178 time for calcul the mask position with numpy : 0.0006642341613769531 nb_pixel_total : 8329 time to create 1 rle with old method : 0.010385274887084961 length of segment : 118 time for calcul the mask position with numpy : 0.5561106204986572 nb_pixel_total : 3913847 time to create 1 rle with new method : 1.0505940914154053 length of segment : 2224 time for calcul the mask position with numpy : 0.0019199848175048828 nb_pixel_total : 143934 time to create 1 rle with old method : 0.16690993309020996 length of segment : 384 time for calcul the mask position with numpy : 0.0005381107330322266 nb_pixel_total : 30933 time to create 1 rle with old method : 0.03803420066833496 length of segment : 234 time for calcul the mask position with numpy : 0.00013756752014160156 nb_pixel_total : 2800 time to create 1 rle with old method : 0.0039103031158447266 length of segment : 48 time spent for convertir_results : 25.016484260559082 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 169 chid ids of type : 3663 Number RLEs to save : 65085 save missing photos in datou_result : time spend for datou_step_exec : 78.94678068161011 time spend to save output : 8.19071078300476 total time spend for step 1 : 87.13749146461487 step2:crop_condition Fri Mar 7 20:53:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3663 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 169 chid ids of type : 3663 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : teint_dans_la_masse param for this class : {'min_score': 0.7} filtre for class : teint_dans_la_masse hashtag_id of this class : 2107752385 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! we have finished the crop for the class : teint_dans_la_masse begin to crop the class : autre_refus param for this class : {'min_score': 0.5} filtre for class : autre_refus hashtag_id of this class : 2107752406 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! we have finished the crop for the class : autre_refus begin to crop the class : carton_gris param for this class : {'min_score': 0.5} filtre for class : carton_gris hashtag_id of this class : 2107753020 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! we have finished the crop for the class : carton_gris begin to crop the class : cartonnette param for this class : {'min_score': 0.5} filtre for class : cartonnette hashtag_id of this class : 702398920 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 61 About to insert : list_path_to_insert length 61 new photo from crops ! we have finished the crop for the class : cartonnette begin to crop the class : carton_brun param for this class : {'min_score': 0.7} filtre for class : carton_brun hashtag_id of this class : 2107753024 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! we have finished the crop for the class : carton_brun begin to crop the class : plastique param for this class : {'min_score': 0.5} filtre for class : plastique hashtag_id of this class : 492725882 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! we have finished the crop for the class : plastique begin to crop the class : kraft param for this class : {'min_score': 0.5} filtre for class : kraft hashtag_id of this class : 493202403 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! we have finished the crop for the class : kraft begin to crop the class : metal param for this class : {'min_score': 0.5} filtre for class : metal hashtag_id of this class : 492628673 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1341536338, 1341535845, 1341535549, 1341535518, 1341535480, 1341535473, 1341535454, 1341535276, 1341535250, 1341522613] Looping around the photos to save general results len do output : 115 /-3697869403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-3697869436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341536338', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535845', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535549', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535518', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535480', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535473', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535454', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535276', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535250', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341522613', None, None, None, None, None, '2649742') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 355 time used for this insertion : 0.04299616813659668 save_final save missing photos in datou_result : time spend for datou_step_exec : 48.09763956069946 time spend to save output : 0.045752525329589844 total time spend for step 2 : 48.14339208602905 step3:thcl Fri Mar 7 20:54:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! nombre de thcls : 2 we are using the classfication for multi_thcl [2456, 2868] time to import caffe and check if the image exist : 0.020355701446533203 time to convert the images to numpy array : 0.277355432510376 time to import caffe and check if the image exist : 0.01261448860168457 time to convert the images to numpy array : 0.3056931495666504 time to import caffe and check if the image exist : 0.022030115127563477 time to convert the images to numpy array : 0.37526416778564453 time to import caffe and check if the image exist : 0.02487039566040039 time to convert the images to numpy array : 0.5021369457244873 time to import caffe and check if the image exist : 0.019928693771362305 time to convert the images to numpy array : 0.5151562690734863 time to import caffe and check if the image exist : 0.01871514320373535 time to convert the images to numpy array : 0.5242190361022949 time to import caffe and check if the image exist : 0.016542434692382812 time to convert the images to numpy array : 0.5468804836273193 time to import caffe and check if the image exist : 0.01854872703552246 time to convert the images to numpy array : 0.5503339767456055 time to import caffe and check if the image exist : 0.022444486618041992 time to convert the images to numpy array : 0.5593357086181641 time to import caffe and check if the image exist : 0.021922588348388672 time to convert the images to numpy array : 0.5886642932891846 total time to convert the images to numpy array : 0.8878886699676514 list photo_ids error: [] list photo_ids correct : [-3697869478, -3697869500, -3697869505, -3697869532, -3697869528, -3697869406, -3697869436, -3697869403, -3697869415, -3697869435, -3697869445, -3697869456, -3697869470, -3697869468, -3697869486, -3697869473, -3697869480, -3697869497, -3697869498, -3697869546, -3697869547, -3697869552, -3697869550, -3697869551, -3697869563, -3697869409, -3697869422, -3697869441, -3697869462, -3697869475, -3697869482, -3697869442, -3697869447, -3697869450, -3697869465, -3697869457, -3697869466, -3697869487, -3697869471, -3697869492, -3697869485, -3697869469, -3697869477, -3697869508, -3697869561, -3697869420, -3697869427, -3697869423, -3697869433, -3697869483, -3697869476, -3697869496, -3697869479, -3697869489, -3697869514, -3697869472, -3697869490, -3697869494, -3697869495, -3697869515, -3697869509, -3697869501, -3697869504, -3697869506, -3697869502, -3697869517, -3697869513, -3697869523, -3697869521, -3697869542, -3697869560, -3697869554, -3697869419, -3697869424, -3697869434, -3697869454, -3697869460, -3697869464, -3697869474, -3697869511, -3697869516, -3697869512, -3697869531, -3697869534, -3697869533, -3697869526, -3697869527, -3697869530, -3697869522, -3697869529, -3697869535, -3697869537, -3697869536, -3697869540, -3697869555, -3697869557, -3697869404, -3697869401, -3697869417, -3697869412, -3697869428, -3697869410, -3697869426, -3697869414, -3697869418, -3697869411, -3697869407, -3697869432, -3697869439, -3697869438, -3697869430, -3697869431, -3697869444, -3697869453, -3697869449] number of photos to traite : 115 try to delete the photos incorrect in DB tagging for thcl : 2456 To do loadFromThcl(), then load ParamDescType : thcl2456 thcls : [{'id': 2456, 'mtr_user_id': 31, 'name': 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'papier,refus', 'svm_portfolios_learning': '3028087,3028251', 'photo_hashtag_type': 3049, 'photo_desc_type': 4999, 'type_classification': 'caffe', 'hashtag_id_list': '492668766,538914404'}] thcl {'id': 2456, 'mtr_user_id': 31, 'name': 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'papier,refus', 'svm_portfolios_learning': '3028087,3028251', 'photo_hashtag_type': 3049, 'photo_desc_type': 4999, 'type_classification': 'caffe', 'hashtag_id_list': '492668766,538914404'} Update svm_hashtag_type_desc : 4999 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (4999, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 16384, 25088, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'res5b', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2020, 10, 23, 14, 27, 22), datetime.datetime(2020, 10, 23, 14, 27, 22)) To loadFromThcl() : net_4999 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10593 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (4999, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 16384, 25088, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'res5b', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2020, 10, 23, 14, 27, 22), datetime.datetime(2020, 10, 23, 14, 27, 22)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_qualipapia_papier_refus_from_vlg_data_aug Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_qualipapia_papier_refus_from_vlg_data_aug model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/caffemodel size_local : 44972172 size in s3 : 44972172 create time local : 2021-08-09 05:55:48 create time in s3 : 2021-08-06 19:28:49 caffemodel already exist and didn't need to update /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/deploy.prototxt size_local : 17311 size in s3 : 17311 create time local : 2021-08-09 05:55:48 create time in s3 : 2021-08-06 19:28:49 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-08-09 05:55:48 create time in s3 : 2021-08-06 19:28:51 mean.npy already exist and didn't need to update /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/synset_words.txt size_local : 57 size in s3 : 57 create time local : 2021-08-09 05:55:48 create time in s3 : 2021-08-06 19:28:49 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/deploy.prototxt caffemodel_filename : /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10374 max_wait_temp : 1 max_wait : 0 dict_keys(['prob']) time used to do the prepocess of the images : 1.3483467102050781 time used to do the prediction : 0.26074671745300293 we don't save the descriptors for this thcl 2456 tagging for thcl : 2868 To do loadFromThcl(), then load ParamDescType : thcl2868 thcls : [{'id': 2868, 'mtr_user_id': 31, 'name': 'learn_papier_nantes_300421', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,environnement,kraft,metal,papier,plastique', 'svm_portfolios_learning': '3752117,3752118,3752123,3752106,3752116,3752124,3752119,3581575,3486029,3752122', 'photo_hashtag_type': 3632, 'photo_desc_type': 5288, 'type_classification': 'caffe', 'hashtag_id_list': '2107753024,2107753020,2107752385,2107752406,702398920,493012381,493202403,492628673,492668766,492725882'}] thcl {'id': 2868, 'mtr_user_id': 31, 'name': 'learn_papier_nantes_300421', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,environnement,kraft,metal,papier,plastique', 'svm_portfolios_learning': '3752117,3752118,3752123,3752106,3752116,3752124,3752119,3581575,3486029,3752122', 'photo_hashtag_type': 3632, 'photo_desc_type': 5288, 'type_classification': 'caffe', 'hashtag_id_list': '2107753024,2107753020,2107752385,2107752406,702398920,493012381,493202403,492628673,492668766,492725882'} Update svm_hashtag_type_desc : 5288 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5288, 'learn_papier_nantes_300421', 512, 512, 'learn_papier_nantes_300421', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 30, 17, 9, 41), datetime.datetime(2021, 4, 30, 17, 9, 41)) To loadFromThcl() : net_5288 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10372 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5288, 'learn_papier_nantes_300421', 512, 512, 'learn_papier_nantes_300421', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 30, 17, 9, 41), datetime.datetime(2021, 4, 30, 17, 9, 41)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_papier_nantes_300421 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_papier_nantes_300421 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_papier_nantes_300421 /data/models_weight/learn_papier_nantes_300421/caffemodel size_local : 44791983 size in s3 : 44791983 create time local : 2021-08-09 05:55:59 create time in s3 : 2021-08-06 19:22:13 caffemodel already exist and didn't need to update /data/models_weight/learn_papier_nantes_300421/deploy.prototxt size_local : 17255 size in s3 : 17255 create time local : 2021-08-09 05:55:59 create time in s3 : 2021-08-06 19:22:12 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_papier_nantes_300421/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-08-09 05:55:59 create time in s3 : 2021-08-06 19:22:14 mean.npy already exist and didn't need to update /data/models_weight/learn_papier_nantes_300421/synset_words.txt size_local : 331 size in s3 : 331 create time local : 2021-08-09 05:56:00 create time in s3 : 2021-08-06 19:22:12 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_papier_nantes_300421/deploy.prototxt caffemodel_filename : /data/models_weight/learn_papier_nantes_300421/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10372 max_wait_temp : 1 max_wait : 0 dict_keys(['prob']) time used to do the prepocess of the images : 1.6227748394012451 time used to do the prediction : 0.20395970344543457 we don't save the descriptors for this thcl 2868 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos test new format of the output of the step_thcl begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 0 time used for this insertion : 1.4543533325195312e-05 save missing photos in datou_result : time spend for datou_step_exec : 11.481711864471436 time spend to save output : 0.0007719993591308594 total time spend for step 3 : 11.482483863830566 step4:merge_mask_thcl_custom Fri Mar 7 20:54:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step merge_mask_thcl_custom batch 1 Loaded 169 chid ids of type : 3663 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++As expected we have just one thcl present End of step merge_mask_thcl_custom Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : merge_mask_thcl_custom we use saveGeneral [1341536338, 1341535845, 1341535549, 1341535518, 1341535480, 1341535473, 1341535454, 1341535276, 1341535250, 1341522613] Looping around the photos to save general results len do output : 10 /1341536338Didn't retrieve data .Didn't retrieve data . /1341535845Didn't retrieve data .Didn't retrieve data . /1341535549Didn't retrieve data .Didn't retrieve data . /1341535518Didn't retrieve data .Didn't retrieve data . /1341535480Didn't retrieve data .Didn't retrieve data . /1341535473Didn't retrieve data .Didn't retrieve data . /1341535454Didn't retrieve data .Didn't retrieve data . /1341535276Didn't retrieve data .Didn't retrieve data . /1341535250Didn't retrieve data .Didn't retrieve data . /1341522613Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341536338', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535845', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535549', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535518', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535480', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535473', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535454', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535276', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535250', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341522613', None, None, None, None, None, '2649742') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.017012834548950195 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.6649603843688965 time spend to save output : 0.017586469650268555 total time spend for step 4 : 0.682546854019165 step5:rle_unique_nms_with_priority Fri Mar 7 20:54:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 7.023113012313843 time for calcul the mask position with numpy : 0.06169915199279785 nb_pixel_total : 2164200 time to create 1 rle with new method : 0.943270206451416 time for calcul the mask position with numpy : 0.03550362586975098 nb_pixel_total : 112313 time to create 1 rle with old method : 0.12657427787780762 time for calcul the mask position with numpy : 0.036579132080078125 nb_pixel_total : 27526 time to create 1 rle with old method : 0.029578208923339844 time for calcul the mask position with numpy : 0.021579265594482422 nb_pixel_total : 9649 time to create 1 rle with old method : 0.011638164520263672 time for calcul the mask position with numpy : 0.021236658096313477 nb_pixel_total : 14393 time to create 1 rle with old method : 0.01638627052307129 time for calcul the mask position with numpy : 0.021778345108032227 nb_pixel_total : 106543 time to create 1 rle with old method : 0.12168002128601074 time for calcul the mask position with numpy : 0.4149942398071289 nb_pixel_total : 4615616 time to create 1 rle with new method : 0.9379217624664307 create new chi : 2.852396249771118 time to delete rle : 0.014609575271606445 batch 1 Loaded 7 chid ids of type : 3726 Number RLEs to save : 11352 TO DO : save crop sub photo not yet done ! save time : 0.6593585014343262 nb_obj : 21 nb_hashtags : 7 time to prepare the origin masks : 14.800984859466553 time for calcul the mask position with numpy : 0.7312726974487305 nb_pixel_total : 5710017 time to create 1 rle with new method : 1.4085078239440918 time for calcul the mask position with numpy : 0.021234512329101562 nb_pixel_total : 10293 time to create 1 rle with old method : 0.011235952377319336 time for calcul the mask position with numpy : 0.023021936416625977 nb_pixel_total : 234603 time to create 1 rle with new method : 0.47994232177734375 time for calcul the mask position with numpy : 0.02153754234313965 nb_pixel_total : 173657 time to create 1 rle with new method : 0.7297396659851074 time for calcul the mask position with numpy : 0.022433042526245117 nb_pixel_total : 56122 time to create 1 rle with old method : 0.06463313102722168 time for calcul the mask position with numpy : 0.02721238136291504 nb_pixel_total : 33795 time to create 1 rle with old method : 0.05329418182373047 time for calcul the mask position with numpy : 0.03095412254333496 nb_pixel_total : 21609 time to create 1 rle with old method : 0.038195133209228516 time for calcul the mask position with numpy : 0.030295372009277344 nb_pixel_total : 75588 time to create 1 rle with old method : 0.1324450969696045 time for calcul the mask position with numpy : 0.028492212295532227 nb_pixel_total : 109291 time to create 1 rle with old method : 0.1884450912475586 time for calcul the mask position with numpy : 0.028496980667114258 nb_pixel_total : 7950 time to create 1 rle with old method : 0.014400005340576172 time for calcul the mask position with numpy : 0.0300905704498291 nb_pixel_total : 35183 time to create 1 rle with old method : 0.04889869689941406 time for calcul the mask position with numpy : 0.02548074722290039 nb_pixel_total : 93084 time to create 1 rle with old method : 0.10252809524536133 time for calcul the mask position with numpy : 0.02563929557800293 nb_pixel_total : 39467 time to create 1 rle with old method : 0.04358625411987305 time for calcul the mask position with numpy : 0.021921396255493164 nb_pixel_total : 66898 time to create 1 rle with old method : 0.07403111457824707 time for calcul the mask position with numpy : 0.02242565155029297 nb_pixel_total : 6381 time to create 1 rle with old method : 0.00742793083190918 time for calcul the mask position with numpy : 0.0216825008392334 nb_pixel_total : 8215 time to create 1 rle with old method : 0.009070873260498047 time for calcul the mask position with numpy : 0.022165775299072266 nb_pixel_total : 39685 time to create 1 rle with old method : 0.04540562629699707 time for calcul the mask position with numpy : 0.022856473922729492 nb_pixel_total : 10605 time to create 1 rle with old method : 0.011852025985717773 time for calcul the mask position with numpy : 0.02366042137145996 nb_pixel_total : 248062 time to create 1 rle with new method : 1.6606135368347168 time for calcul the mask position with numpy : 0.03420829772949219 nb_pixel_total : 11062 time to create 1 rle with old method : 0.01218867301940918 time for calcul the mask position with numpy : 0.03436636924743652 nb_pixel_total : 48430 time to create 1 rle with old method : 0.05697488784790039 time for calcul the mask position with numpy : 0.03658151626586914 nb_pixel_total : 10243 time to create 1 rle with old method : 0.011495351791381836 create new chi : 6.603623390197754 time to delete rle : 0.0016376972198486328 batch 1 Loaded 22 chid ids of type : 3726 Number RLEs to save : 14726 TO DO : save crop sub photo not yet done ! save time : 1.3323886394500732 nb_obj : 11 nb_hashtags : 4 time to prepare the origin masks : 8.285094976425171 time for calcul the mask position with numpy : 0.31371235847473145 nb_pixel_total : 6308080 time to create 1 rle with new method : 1.3563528060913086 time for calcul the mask position with numpy : 0.035737037658691406 nb_pixel_total : 39032 time to create 1 rle with old method : 0.04504704475402832 time for calcul the mask position with numpy : 0.040717124938964844 nb_pixel_total : 252339 time to create 1 rle with new method : 1.2261276245117188 time for calcul the mask position with numpy : 0.03549695014953613 nb_pixel_total : 26164 time to create 1 rle with old method : 0.028804779052734375 time for calcul the mask position with numpy : 0.03511619567871094 nb_pixel_total : 4969 time to create 1 rle with old method : 0.005712985992431641 time for calcul the mask position with numpy : 0.03922104835510254 nb_pixel_total : 27451 time to create 1 rle with old method : 0.04298543930053711 time for calcul the mask position with numpy : 0.040548086166381836 nb_pixel_total : 48931 time to create 1 rle with old method : 0.07680153846740723 time for calcul the mask position with numpy : 0.028212547302246094 nb_pixel_total : 59548 time to create 1 rle with old method : 0.06763148307800293 time for calcul the mask position with numpy : 0.02463984489440918 nb_pixel_total : 3830 time to create 1 rle with old method : 0.005251884460449219 time for calcul the mask position with numpy : 0.023030757904052734 nb_pixel_total : 14004 time to create 1 rle with old method : 0.01636338233947754 time for calcul the mask position with numpy : 0.023172378540039062 nb_pixel_total : 130161 time to create 1 rle with old method : 0.1475234031677246 time for calcul the mask position with numpy : 0.023445844650268555 nb_pixel_total : 135731 time to create 1 rle with old method : 0.1510317325592041 create new chi : 3.8997116088867188 time to delete rle : 0.0009484291076660156 batch 1 Loaded 12 chid ids of type : 3726 Number RLEs to save : 9885 TO DO : save crop sub photo not yet done ! save time : 0.708449125289917 nb_obj : 14 nb_hashtags : 6 time to prepare the origin masks : 9.759303569793701 time for calcul the mask position with numpy : 0.6376392841339111 nb_pixel_total : 6199898 time to create 1 rle with new method : 0.8870007991790771 time for calcul the mask position with numpy : 0.02263951301574707 nb_pixel_total : 101660 time to create 1 rle with old method : 0.11595582962036133 time for calcul the mask position with numpy : 0.02294301986694336 nb_pixel_total : 12590 time to create 1 rle with old method : 0.01454472541809082 time for calcul the mask position with numpy : 0.021875381469726562 nb_pixel_total : 51272 time to create 1 rle with old method : 0.058890581130981445 time for calcul the mask position with numpy : 0.024026155471801758 nb_pixel_total : 108907 time to create 1 rle with old method : 0.12386512756347656 time for calcul the mask position with numpy : 0.03437519073486328 nb_pixel_total : 43177 time to create 1 rle with old method : 0.0507655143737793 time for calcul the mask position with numpy : 0.03431296348571777 nb_pixel_total : 23066 time to create 1 rle with old method : 0.030712366104125977 time for calcul the mask position with numpy : 0.03439831733703613 nb_pixel_total : 89078 time to create 1 rle with old method : 0.10084652900695801 time for calcul the mask position with numpy : 0.03442978858947754 nb_pixel_total : 14426 time to create 1 rle with old method : 0.0160825252532959 time for calcul the mask position with numpy : 0.0345149040222168 nb_pixel_total : 249 time to create 1 rle with old method : 0.00036907196044921875 time for calcul the mask position with numpy : 0.033887624740600586 nb_pixel_total : 3850 time to create 1 rle with old method : 0.004556894302368164 time for calcul the mask position with numpy : 0.025744199752807617 nb_pixel_total : 11209 time to create 1 rle with old method : 0.012560606002807617 time for calcul the mask position with numpy : 0.022814512252807617 nb_pixel_total : 39647 time to create 1 rle with old method : 0.04385852813720703 time for calcul the mask position with numpy : 0.02592015266418457 nb_pixel_total : 332947 time to create 1 rle with new method : 0.6853413581848145 time for calcul the mask position with numpy : 0.021903276443481445 nb_pixel_total : 18264 time to create 1 rle with old method : 0.020183563232421875 create new chi : 3.2618825435638428 time to delete rle : 0.000978231430053711 batch 1 Loaded 15 chid ids of type : 3726 Number RLEs to save : 10463 TO DO : save crop sub photo not yet done ! save time : 0.6185410022735596 nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 10.286608934402466 time for calcul the mask position with numpy : 1.0088169574737549 nb_pixel_total : 6085161 time to create 1 rle with new method : 0.7728099822998047 time for calcul the mask position with numpy : 0.03607988357543945 nb_pixel_total : 206447 time to create 1 rle with new method : 0.7399976253509521 time for calcul the mask position with numpy : 0.0346217155456543 nb_pixel_total : 127601 time to create 1 rle with old method : 0.13314557075500488 time for calcul the mask position with numpy : 0.03426480293273926 nb_pixel_total : 252831 time to create 1 rle with new method : 0.7178797721862793 time for calcul the mask position with numpy : 0.03540182113647461 nb_pixel_total : 128620 time to create 1 rle with old method : 0.1437363624572754 time for calcul the mask position with numpy : 0.03387618064880371 nb_pixel_total : 13316 time to create 1 rle with old method : 0.017791748046875 time for calcul the mask position with numpy : 0.03342127799987793 nb_pixel_total : 4574 time to create 1 rle with old method : 0.004994392395019531 time for calcul the mask position with numpy : 0.024282217025756836 nb_pixel_total : 52944 time to create 1 rle with old method : 0.05730915069580078 time for calcul the mask position with numpy : 0.02073192596435547 nb_pixel_total : 5416 time to create 1 rle with old method : 0.005915164947509766 time for calcul the mask position with numpy : 0.02285623550415039 nb_pixel_total : 28319 time to create 1 rle with old method : 0.03220844268798828 time for calcul the mask position with numpy : 0.022437572479248047 nb_pixel_total : 103348 time to create 1 rle with old method : 0.11022806167602539 time for calcul the mask position with numpy : 0.021556377410888672 nb_pixel_total : 17966 time to create 1 rle with old method : 0.019015789031982422 time for calcul the mask position with numpy : 0.021833181381225586 nb_pixel_total : 23697 time to create 1 rle with old method : 0.025351524353027344 create new chi : 4.214113473892212 time to delete rle : 0.0010223388671875 batch 1 Loaded 13 chid ids of type : 3726 Number RLEs to save : 10283 TO DO : save crop sub photo not yet done ! save time : 1.3117222785949707 nb_obj : 28 nb_hashtags : 7 time to prepare the origin masks : 10.598727226257324 time for calcul the mask position with numpy : 0.3497023582458496 nb_pixel_total : 6122410 time to create 1 rle with new method : 0.8480961322784424 time for calcul the mask position with numpy : 0.02797532081604004 nb_pixel_total : 44903 time to create 1 rle with old method : 0.04737687110900879 time for calcul the mask position with numpy : 0.028005361557006836 nb_pixel_total : 27397 time to create 1 rle with old method : 0.030390501022338867 time for calcul the mask position with numpy : 0.027486324310302734 nb_pixel_total : 3293 time to create 1 rle with old method : 0.0038170814514160156 time for calcul the mask position with numpy : 0.02899026870727539 nb_pixel_total : 115068 time to create 1 rle with old method : 0.11911439895629883 time for calcul the mask position with numpy : 0.028128623962402344 nb_pixel_total : 9052 time to create 1 rle with old method : 0.009391069412231445 time for calcul the mask position with numpy : 0.027943849563598633 nb_pixel_total : 26951 time to create 1 rle with old method : 0.027764081954956055 time for calcul the mask position with numpy : 0.02811455726623535 nb_pixel_total : 33658 time to create 1 rle with old method : 0.03552699089050293 time for calcul the mask position with numpy : 0.028784513473510742 nb_pixel_total : 56969 time to create 1 rle with old method : 0.060034990310668945 time for calcul the mask position with numpy : 0.028853654861450195 nb_pixel_total : 105801 time to create 1 rle with old method : 0.13936662673950195 time for calcul the mask position with numpy : 0.03712916374206543 nb_pixel_total : 3956 time to create 1 rle with old method : 0.007206916809082031 time for calcul the mask position with numpy : 0.03364825248718262 nb_pixel_total : 51548 time to create 1 rle with old method : 0.059328317642211914 time for calcul the mask position with numpy : 0.03009510040283203 nb_pixel_total : 32782 time to create 1 rle with old method : 0.038721561431884766 time for calcul the mask position with numpy : 0.031408071517944336 nb_pixel_total : 63231 time to create 1 rle with old method : 0.07228970527648926 time for calcul the mask position with numpy : 0.029312610626220703 nb_pixel_total : 19038 time to create 1 rle with old method : 0.020946025848388672 time for calcul the mask position with numpy : 0.028957843780517578 nb_pixel_total : 5141 time to create 1 rle with old method : 0.005677700042724609 time for calcul the mask position with numpy : 0.029300451278686523 nb_pixel_total : 36602 time to create 1 rle with old method : 0.04271888732910156 time for calcul the mask position with numpy : 0.029285907745361328 nb_pixel_total : 3380 time to create 1 rle with old method : 0.003782987594604492 time for calcul the mask position with numpy : 0.028909921646118164 nb_pixel_total : 4917 time to create 1 rle with old method : 0.005852937698364258 time for calcul the mask position with numpy : 0.030538082122802734 nb_pixel_total : 132108 time to create 1 rle with old method : 0.1454010009765625 time for calcul the mask position with numpy : 0.04477977752685547 nb_pixel_total : 78031 time to create 1 rle with old method : 0.14907550811767578 time for calcul the mask position with numpy : 0.041697025299072266 nb_pixel_total : 29612 time to create 1 rle with old method : 0.03377580642700195 time for calcul the mask position with numpy : 0.039794921875 nb_pixel_total : 2233 time to create 1 rle with old method : 0.004004240036010742 time for calcul the mask position with numpy : 0.03322911262512207 nb_pixel_total : 1788 time to create 1 rle with old method : 0.0024919509887695312 time for calcul the mask position with numpy : 0.029792070388793945 nb_pixel_total : 20898 time to create 1 rle with old method : 0.02281475067138672 time for calcul the mask position with numpy : 0.030309438705444336 nb_pixel_total : 7870 time to create 1 rle with old method : 0.008781194686889648 time for calcul the mask position with numpy : 0.02921462059020996 nb_pixel_total : 5638 time to create 1 rle with old method : 0.006651639938354492 time for calcul the mask position with numpy : 0.02906036376953125 nb_pixel_total : 2251 time to create 1 rle with old method : 0.0024988651275634766 time for calcul the mask position with numpy : 0.03276968002319336 nb_pixel_total : 3714 time to create 1 rle with old method : 0.0043179988861083984 create new chi : 3.2185378074645996 time to delete rle : 0.0020737648010253906 batch 1 Loaded 29 chid ids of type : 3726 Number RLEs to save : 17618 TO DO : save crop sub photo not yet done ! save time : 1.350801706314087 nb_obj : 22 nb_hashtags : 9 time to prepare the origin masks : 15.920758962631226 time for calcul the mask position with numpy : 0.33966612815856934 nb_pixel_total : 5732969 time to create 1 rle with new method : 0.6857938766479492 time for calcul the mask position with numpy : 0.027223587036132812 nb_pixel_total : 18804 time to create 1 rle with old method : 0.021007537841796875 time for calcul the mask position with numpy : 0.021296024322509766 nb_pixel_total : 35412 time to create 1 rle with old method : 0.0395512580871582 time for calcul the mask position with numpy : 0.025103330612182617 nb_pixel_total : 1450 time to create 1 rle with old method : 0.0018808841705322266 time for calcul the mask position with numpy : 0.02414107322692871 nb_pixel_total : 43256 time to create 1 rle with old method : 0.05038261413574219 time for calcul the mask position with numpy : 0.02546072006225586 nb_pixel_total : 3878 time to create 1 rle with old method : 0.004839420318603516 time for calcul the mask position with numpy : 0.025697708129882812 nb_pixel_total : 141741 time to create 1 rle with old method : 0.16049528121948242 time for calcul the mask position with numpy : 0.024194002151489258 nb_pixel_total : 57480 time to create 1 rle with old method : 0.06644701957702637 time for calcul the mask position with numpy : 0.02079486846923828 nb_pixel_total : 30274 time to create 1 rle with old method : 0.034563541412353516 time for calcul the mask position with numpy : 0.021030664443969727 nb_pixel_total : 31943 time to create 1 rle with old method : 0.03617501258850098 time for calcul the mask position with numpy : 0.021180152893066406 nb_pixel_total : 65662 time to create 1 rle with old method : 0.07215213775634766 time for calcul the mask position with numpy : 0.020066022872924805 nb_pixel_total : 4952 time to create 1 rle with old method : 0.0054590702056884766 time for calcul the mask position with numpy : 0.02021503448486328 nb_pixel_total : 4704 time to create 1 rle with old method : 0.005282878875732422 time for calcul the mask position with numpy : 0.023557424545288086 nb_pixel_total : 119362 time to create 1 rle with old method : 0.14574813842773438 time for calcul the mask position with numpy : 0.021422147750854492 nb_pixel_total : 970 time to create 1 rle with old method : 0.0011098384857177734 time for calcul the mask position with numpy : 0.020807743072509766 nb_pixel_total : 24450 time to create 1 rle with old method : 0.026215791702270508 time for calcul the mask position with numpy : 0.021831750869750977 nb_pixel_total : 67725 time to create 1 rle with old method : 0.07395648956298828 time for calcul the mask position with numpy : 0.02282857894897461 nb_pixel_total : 113672 time to create 1 rle with old method : 0.12673592567443848 time for calcul the mask position with numpy : 0.022902488708496094 nb_pixel_total : 172167 time to create 1 rle with new method : 0.5979275703430176 time for calcul the mask position with numpy : 0.023984670639038086 nb_pixel_total : 2328 time to create 1 rle with old method : 0.0038022994995117188 time for calcul the mask position with numpy : 0.02569890022277832 nb_pixel_total : 131976 time to create 1 rle with old method : 0.14479660987854004 time for calcul the mask position with numpy : 0.025127172470092773 nb_pixel_total : 21435 time to create 1 rle with old method : 0.023911714553833008 time for calcul the mask position with numpy : 0.02371501922607422 nb_pixel_total : 223630 time to create 1 rle with new method : 0.6306982040405273 create new chi : 3.894643783569336 time to delete rle : 0.0024411678314208984 batch 1 Loaded 23 chid ids of type : 3726 Number RLEs to save : 17363 TO DO : save crop sub photo not yet done ! save time : 2.747603178024292 nb_obj : 21 nb_hashtags : 7 time to prepare the origin masks : 15.38925576210022 time for calcul the mask position with numpy : 0.3884727954864502 nb_pixel_total : 4733484 time to create 1 rle with new method : 0.5201559066772461 time for calcul the mask position with numpy : 0.03778362274169922 nb_pixel_total : 26411 time to create 1 rle with old method : 0.02855515480041504 time for calcul the mask position with numpy : 0.03224039077758789 nb_pixel_total : 30971 time to create 1 rle with old method : 0.0318150520324707 time for calcul the mask position with numpy : 0.02595353126525879 nb_pixel_total : 3119 time to create 1 rle with old method : 0.0035686492919921875 time for calcul the mask position with numpy : 0.022973299026489258 nb_pixel_total : 1716 time to create 1 rle with old method : 0.001954317092895508 time for calcul the mask position with numpy : 0.02308797836303711 nb_pixel_total : 49024 time to create 1 rle with old method : 0.05004763603210449 time for calcul the mask position with numpy : 0.023505449295043945 nb_pixel_total : 29496 time to create 1 rle with old method : 0.03128957748413086 time for calcul the mask position with numpy : 0.024969100952148438 nb_pixel_total : 200189 time to create 1 rle with new method : 0.5062272548675537 time for calcul the mask position with numpy : 0.022336483001708984 nb_pixel_total : 99599 time to create 1 rle with old method : 0.10618162155151367 time for calcul the mask position with numpy : 0.023640155792236328 nb_pixel_total : 92937 time to create 1 rle with old method : 0.09642744064331055 time for calcul the mask position with numpy : 0.02311420440673828 nb_pixel_total : 97607 time to create 1 rle with old method : 0.09918618202209473 time for calcul the mask position with numpy : 0.024448394775390625 nb_pixel_total : 165568 time to create 1 rle with new method : 0.7691659927368164 time for calcul the mask position with numpy : 0.023921728134155273 nb_pixel_total : 77937 time to create 1 rle with old method : 0.0809473991394043 time for calcul the mask position with numpy : 0.024532556533813477 nb_pixel_total : 89637 time to create 1 rle with old method : 0.09541749954223633 time for calcul the mask position with numpy : 0.024401426315307617 nb_pixel_total : 44216 time to create 1 rle with old method : 0.047985076904296875 time for calcul the mask position with numpy : 0.023970365524291992 nb_pixel_total : 10049 time to create 1 rle with old method : 0.010266304016113281 time for calcul the mask position with numpy : 0.03970813751220703 nb_pixel_total : 1152914 time to create 1 rle with new method : 0.7615511417388916 time for calcul the mask position with numpy : 0.027958154678344727 nb_pixel_total : 2408 time to create 1 rle with old method : 0.003087759017944336 time for calcul the mask position with numpy : 0.02602219581604004 nb_pixel_total : 30278 time to create 1 rle with old method : 0.03142142295837402 time for calcul the mask position with numpy : 0.03931593894958496 nb_pixel_total : 1594 time to create 1 rle with old method : 0.001743316650390625 time for calcul the mask position with numpy : 0.039028167724609375 nb_pixel_total : 107906 time to create 1 rle with old method : 0.11222076416015625 time for calcul the mask position with numpy : 0.038184165954589844 nb_pixel_total : 3180 time to create 1 rle with old method : 0.0034363269805908203 create new chi : 4.500750303268433 time to delete rle : 0.0018451213836669922 batch 1 Loaded 22 chid ids of type : 3726 Number RLEs to save : 18575 TO DO : save crop sub photo not yet done ! save time : 2.581376075744629 nb_obj : 23 nb_hashtags : 7 time to prepare the origin masks : 16.638707876205444 time for calcul the mask position with numpy : 0.42722558975219727 nb_pixel_total : 5633501 time to create 1 rle with new method : 0.7809743881225586 time for calcul the mask position with numpy : 0.021943330764770508 nb_pixel_total : 4492 time to create 1 rle with old method : 0.00479578971862793 time for calcul the mask position with numpy : 0.02138519287109375 nb_pixel_total : 57353 time to create 1 rle with old method : 0.06502485275268555 time for calcul the mask position with numpy : 0.02270364761352539 nb_pixel_total : 38926 time to create 1 rle with old method : 0.04673600196838379 time for calcul the mask position with numpy : 0.022674560546875 nb_pixel_total : 173998 time to create 1 rle with new method : 0.8597078323364258 time for calcul the mask position with numpy : 0.024068117141723633 nb_pixel_total : 15785 time to create 1 rle with old method : 0.01867985725402832 time for calcul the mask position with numpy : 0.022350788116455078 nb_pixel_total : 43162 time to create 1 rle with old method : 0.050411224365234375 time for calcul the mask position with numpy : 0.03541851043701172 nb_pixel_total : 3228 time to create 1 rle with old method : 0.0037953853607177734 time for calcul the mask position with numpy : 0.03742861747741699 nb_pixel_total : 211828 time to create 1 rle with new method : 1.281902551651001 time for calcul the mask position with numpy : 0.04084515571594238 nb_pixel_total : 147488 time to create 1 rle with old method : 0.16211485862731934 time for calcul the mask position with numpy : 0.03727436065673828 nb_pixel_total : 80622 time to create 1 rle with old method : 0.09456181526184082 time for calcul the mask position with numpy : 0.03520035743713379 nb_pixel_total : 24555 time to create 1 rle with old method : 0.02667832374572754 time for calcul the mask position with numpy : 0.03608369827270508 nb_pixel_total : 1906 time to create 1 rle with old method : 0.0023925304412841797 time for calcul the mask position with numpy : 0.03674173355102539 nb_pixel_total : 30590 time to create 1 rle with old method : 0.03570699691772461 time for calcul the mask position with numpy : 0.03640007972717285 nb_pixel_total : 9190 time to create 1 rle with old method : 0.010700702667236328 time for calcul the mask position with numpy : 0.035436391830444336 nb_pixel_total : 23065 time to create 1 rle with old method : 0.027913570404052734 time for calcul the mask position with numpy : 0.03876185417175293 nb_pixel_total : 67592 time to create 1 rle with old method : 0.07512331008911133 time for calcul the mask position with numpy : 0.036332130432128906 nb_pixel_total : 219936 time to create 1 rle with new method : 0.670600414276123 time for calcul the mask position with numpy : 0.03557538986206055 nb_pixel_total : 12319 time to create 1 rle with old method : 0.014294147491455078 time for calcul the mask position with numpy : 0.037744998931884766 nb_pixel_total : 6748 time to create 1 rle with old method : 0.007491588592529297 time for calcul the mask position with numpy : 0.03769087791442871 nb_pixel_total : 108824 time to create 1 rle with old method : 0.14463257789611816 time for calcul the mask position with numpy : 0.035312652587890625 nb_pixel_total : 22869 time to create 1 rle with old method : 0.02521991729736328 time for calcul the mask position with numpy : 0.04041934013366699 nb_pixel_total : 17242 time to create 1 rle with old method : 0.019003868103027344 time for calcul the mask position with numpy : 0.037450551986694336 nb_pixel_total : 95021 time to create 1 rle with old method : 0.10567116737365723 create new chi : 5.842464208602905 time to delete rle : 0.002094268798828125 batch 1 Loaded 24 chid ids of type : 3726 Number RLEs to save : 18130 TO DO : save crop sub photo not yet done ! save time : 1.1218760013580322 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 3.9236788749694824 time for calcul the mask position with numpy : 0.3510282039642334 nb_pixel_total : 2995081 time to create 1 rle with new method : 0.7758092880249023 time for calcul the mask position with numpy : 0.022063016891479492 nb_pixel_total : 2723 time to create 1 rle with old method : 0.0031201839447021484 time for calcul the mask position with numpy : 0.02256298065185547 nb_pixel_total : 143141 time to create 1 rle with old method : 0.15534663200378418 time for calcul the mask position with numpy : 0.24216675758361816 nb_pixel_total : 3909295 time to create 1 rle with new method : 1.334869623184204 create new chi : 2.9786808490753174 time to delete rle : 0.0012066364288330078 batch 1 Loaded 4 chid ids of type : 3726 Number RLEs to save : 7296 TO DO : save crop sub photo not yet done ! save time : 0.8809874057769775 map_output_result : {1341536338: (0.0, 'Should be the crop_list due to order', 0), 1341535845: (0.0, 'Should be the crop_list due to order', 0), 1341535549: (0.0, 'Should be the crop_list due to order', 0), 1341535518: (0.0, 'Should be the crop_list due to order', 0), 1341535480: (0.0, 'Should be the crop_list due to order', 0), 1341535473: (0.0, 'Should be the crop_list due to order', 0), 1341535454: (0.0, 'Should be the crop_list due to order', 0), 1341535276: (0.0, 'Should be the crop_list due to order', 0), 1341535250: (0.0, 'Should be the crop_list due to order', 0), 1341522613: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1341536338, 1341535845, 1341535549, 1341535518, 1341535480, 1341535473, 1341535454, 1341535276, 1341535250, 1341522613] Looping around the photos to save general results len do output : 10 /1341536338.Didn't retrieve data . /1341535845.Didn't retrieve data . /1341535549.Didn't retrieve data . /1341535518.Didn't retrieve data . /1341535480.Didn't retrieve data . /1341535473.Didn't retrieve data . /1341535454.Didn't retrieve data . /1341535276.Didn't retrieve data . /1341535250.Didn't retrieve data . /1341522613.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341536338', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535845', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535549', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535518', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535480', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535473', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535454', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535276', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535250', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341522613', None, None, None, None, None, '2649742') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.014889001846313477 save_final save missing photos in datou_result : time spend for datou_step_exec : 168.60411834716797 time spend to save output : 0.015462398529052734 total time spend for step 5 : 168.61958074569702 step6:crop_condition Fri Mar 7 20:57:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 3726 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 171 chid ids of type : 3726 begin to crop the class : teint_dans_la_masse param for this class : {'min_score': 0.7} filtre for class : teint_dans_la_masse hashtag_id of this class : 2107752385 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 4869462 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741377475_499432 we have uploaded 6 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.154202699661255 we have finished the crop for the class : teint_dans_la_masse begin to crop the class : autre_refus param for this class : {'min_score': 0.5} filtre for class : autre_refus hashtag_id of this class : 2107752406 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 4869462 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741377483_499432 we have uploaded 10 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.570929527282715 we have finished the crop for the class : autre_refus begin to crop the class : carton_gris param for this class : {'min_score': 0.5} filtre for class : carton_gris hashtag_id of this class : 2107753020 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 4869462 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741377490_499432 we have uploaded 10 photos in the portfolio 4869462 time of upload the photos Elapsed time : 4.233619213104248 we have finished the crop for the class : carton_gris begin to crop the class : cartonnette param for this class : {'min_score': 0.5} filtre for class : cartonnette hashtag_id of this class : 702398920 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741377497_499432 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.0512681007385254 we have finished the crop for the class : cartonnette begin to crop the class : carton_brun param for this class : {'min_score': 0.7} filtre for class : carton_brun hashtag_id of this class : 2107753024 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 4869462 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741377501_499432 we have uploaded 8 photos in the portfolio 4869462 time of upload the photos Elapsed time : 6.188574552536011 we have finished the crop for the class : carton_brun begin to crop the class : plastique param for this class : {'min_score': 0.5} filtre for class : plastique hashtag_id of this class : 492725882 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 4869462 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741377510_499432 we have uploaded 4 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.3105731010437012 we have finished the crop for the class : plastique begin to crop the class : kraft param for this class : {'min_score': 0.5} filtre for class : kraft hashtag_id of this class : 493202403 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741377514_499432 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.4230804443359375 we have finished the crop for the class : kraft begin to crop the class : metal param for this class : {'min_score': 0.5} filtre for class : metal hashtag_id of this class : 492628673 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1341536338, 1341535845, 1341535549, 1341535518, 1341535480, 1341535473, 1341535454, 1341535276, 1341535250, 1341522613] Looping around the photos to save general results len do output : 42 /1341560603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341560804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341561002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341561004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341561005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341561006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341561008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341561009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341561010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341561012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341561028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341561029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341561030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341561033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341561041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341561043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341536338', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535845', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535549', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535518', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535480', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535473', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535454', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535276', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535250', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341522613', None, None, None, None, None, '2649742') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 136 time used for this insertion : 0.8502824306488037 save_final save missing photos in datou_result : time spend for datou_step_exec : 50.22827458381653 time spend to save output : 0.851996660232544 total time spend for step 6 : 51.08027124404907 step7:ventilate_hashtags_in_portfolio Fri Mar 7 20:58:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! To do loadFromThcl(), then load ParamDescType : thcl2725 thcls : [{'id': 2725, 'mtr_user_id': 31, 'name': 'learn_qualipapia_rle_210302_2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,environnement,kraft,metal,papier,plastique', 'svm_portfolios_learning': '3460440,3460441,3460446,3460434,3460439,3467416,3460442,3460443,3486028,3460445', 'photo_hashtag_type': 3410, 'photo_desc_type': 5186, 'type_classification': 'caffe', 'hashtag_id_list': '2107753024,2107753020,2107752385,2107752406,702398920,493012381,493202403,492628673,492668766,492725882'}] thcl {'id': 2725, 'mtr_user_id': 31, 'name': 'learn_qualipapia_rle_210302_2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,environnement,kraft,metal,papier,plastique', 'svm_portfolios_learning': '3460440,3460441,3460446,3460434,3460439,3467416,3460442,3460443,3486028,3460445', 'photo_hashtag_type': 3410, 'photo_desc_type': 5186, 'type_classification': 'caffe', 'hashtag_id_list': '2107753024,2107753020,2107752385,2107752406,702398920,493012381,493202403,492628673,492668766,492725882'} Update svm_hashtag_type_desc : 5186 Iterating over portfolio : 21159305 get user id for portfolio 21159305 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21159305 AND mptpi.`type`=3726 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','papier','plastique','cartonnette','Carton_brun','Teint_Dans_La_Masse','environnement','kraft','Carton_gris','metal','autre_refus','flou')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21159305 AND mptpi.`type`=3726 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','papier','plastique','cartonnette','Carton_brun','Teint_Dans_La_Masse','environnement','kraft','Carton_gris','metal','autre_refus','flou')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21159305 AND mptpi.`type`=3726 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','papier','plastique','cartonnette','Carton_brun','Teint_Dans_La_Masse','environnement','kraft','Carton_gris','metal','autre_refus','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/21159416,21159417,21159418,21159419,21159420,21159421,21159422,21159423,21159424,21159425,21159426,21159427?tags=mal_croppe,papier,plastique,cartonnette,Carton_brun,Teint_Dans_La_Masse,environnement,kraft,Carton_gris,metal,autre_refus,flou Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1341536338, 1341535845, 1341535549, 1341535518, 1341535480, 1341535473, 1341535454, 1341535276, 1341535250, 1341522613] Looping around the photos to save general results len do output : 1 /21159305. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341536338', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535845', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535549', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535518', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535480', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535473', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535454', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535276', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535250', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341522613', None, None, None, None, None, '2649742') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.01882314682006836 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.083666563034058 time spend to save output : 0.01911473274230957 total time spend for step 7 : 8.102781295776367 step8:final Fri Mar 7 20:58:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1341536338: ('0.11123380209136985',), 1341535845: ('0.11123380209136985',), 1341535549: ('0.11123380209136985',), 1341535518: ('0.11123380209136985',), 1341535480: ('0.11123380209136985',), 1341535473: ('0.11123380209136985',), 1341535454: ('0.11123380209136985',), 1341535276: ('0.11123380209136985',), 1341535250: ('0.11123380209136985',), 1341522613: ('0.11123380209136985',)} new output for save of step final : {1341536338: ('0.11123380209136985',), 1341535845: ('0.11123380209136985',), 1341535549: ('0.11123380209136985',), 1341535518: ('0.11123380209136985',), 1341535480: ('0.11123380209136985',), 1341535473: ('0.11123380209136985',), 1341535454: ('0.11123380209136985',), 1341535276: ('0.11123380209136985',), 1341535250: ('0.11123380209136985',), 1341522613: ('0.11123380209136985',)} [1341536338, 1341535845, 1341535549, 1341535518, 1341535480, 1341535473, 1341535454, 1341535276, 1341535250, 1341522613] Looping around the photos to save general results len do output : 10 /1341536338.Didn't retrieve data . /1341535845.Didn't retrieve data . /1341535549.Didn't retrieve data . /1341535518.Didn't retrieve data . /1341535480.Didn't retrieve data . /1341535473.Didn't retrieve data . /1341535454.Didn't retrieve data . /1341535276.Didn't retrieve data . /1341535250.Didn't retrieve data . /1341522613.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341536338', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535845', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535549', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535518', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535480', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535473', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535454', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535276', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535250', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341522613', None, None, None, None, None, '2649742') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.01628732681274414 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10284423828125 time spend to save output : 0.017042160034179688 total time spend for step 8 : 0.11988639831542969 step9:velours_tree Fri Mar 7 20:58:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.10071778297424316 time spend to save output : 5.555152893066406e-05 total time spend for step 9 : 0.10077333450317383 step10:send_mail_cod Fri Mar 7 20:58:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P21159305_07-03-2025_20_58_45.pdf 21159416 imagette211594161741377525 21159418 change filename to text .change filename to text .change filename to text .change filename to text .imagette211594181741377525 21159419 change filename to text .change filename to text .imagette211594191741377525 21159423 change filename to text .change filename to text .imagette211594231741377525 21159425 imagette211594251741377526 21159426 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211594261741377526 21159427 imagette211594271741377526 21159420 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211594201741377526 21159421 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211594211741377527 21159424 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211594241741377527 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21159305 and hashtag_type = 3726 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21159416,21159417,21159418,21159419,21159420,21159421,21159422,21159423,21159424,21159425,21159426,21159427?tags=mal_croppe,papier,plastique,cartonnette,Carton_brun,Teint_Dans_La_Masse,environnement,kraft,Carton_gris,metal,autre_refus,flou your option no_mail is active, we will not send the real mail to your client args[1341536338] : ('0.11123380209136985',) no score found for photo 1341536338 We are sending mail with results at report@fotonower.com args[1341535845] : ('0.11123380209136985',) no score found for photo 1341535845 We are sending mail with results at report@fotonower.com args[1341535549] : ('0.11123380209136985',) no score found for photo 1341535549 We are sending mail with results at report@fotonower.com args[1341535518] : ('0.11123380209136985',) no score found for photo 1341535518 We are sending mail with results at report@fotonower.com args[1341535480] : ('0.11123380209136985',) no score found for photo 1341535480 We are sending mail with results at report@fotonower.com args[1341535473] : ('0.11123380209136985',) no score found for photo 1341535473 We are sending mail with results at report@fotonower.com args[1341535454] : ('0.11123380209136985',) no score found for photo 1341535454 We are sending mail with results at report@fotonower.com args[1341535276] : ('0.11123380209136985',) no score found for photo 1341535276 We are sending mail with results at report@fotonower.com args[1341535250] : ('0.11123380209136985',) no score found for photo 1341535250 We are sending mail with results at report@fotonower.com args[1341522613] : ('0.11123380209136985',) no score found for photo 1341522613 We are sending mail with results at report@fotonower.com refus_total : 0.11123380209136985 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21159305 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1341521216,1341535845,1341535549,1341535518,1341535480,1341535473,1341535454,1341535250,1341522609,1341521511,1341521423,1341521326,1341521269,1341521225,1341521221,1341522295,1341522301,1341522613,1341535276,1341521229) Found this number of photos: 20 begin to download photo : 1341521216 begin to download photo : 1341535473 begin to download photo : 1341521423 begin to download photo : 1341522295 download finish for photo 1341521216 begin to download photo : 1341535845 download finish for photo 1341535473 begin to download photo : 1341535454 download finish for photo 1341521423 begin to download photo : 1341521326 download finish for photo 1341522295 begin to download photo : 1341522301 download finish for photo 1341535845 begin to download photo : 1341535549 download finish for photo 1341535454 begin to download photo : 1341535250 download finish for photo 1341522301 begin to download photo : 1341522613 download finish for photo 1341521326 begin to download photo : 1341521269 download finish for photo 1341535250 begin to download photo : 1341522609 download finish for photo 1341521269 begin to download photo : 1341521225 download finish for photo 1341522613 begin to download photo : 1341535276 download finish for photo 1341535549 begin to download photo : 1341535518 download finish for photo 1341521225 begin to download photo : 1341521221 download finish for photo 1341535276 begin to download photo : 1341521229 download finish for photo 1341535518 begin to download photo : 1341535480 download finish for photo 1341522609 begin to download photo : 1341521511 download finish for photo 1341521221 download finish for photo 1341521229 download finish for photo 1341535480 download finish for photo 1341521511 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21159305_07-03-2025_20_58_45.pdf results_Auto_P21159305_07-03-2025_20_58_45.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21159305_07-03-2025_20_58_45.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3459','21159305','results_Auto_P21159305_07-03-2025_20_58_45.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21159305_07-03-2025_20_58_45.pdf','pdf','','0.89','0.11123380209136985') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1341536338, 1341535845, 1341535549, 1341535518, 1341535480, 1341535473, 1341535454, 1341535276, 1341535250, 1341522613] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341536338', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535845', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535549', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535518', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535480', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535473', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535454', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535276', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535250', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341522613', None, None, None, None, None, '2649742') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.02008533477783203 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.829006671905518 time spend to save output : 0.020467519760131836 total time spend for step 10 : 6.849474191665649 step11:split_time_score Fri Mar 7 20:58:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 22),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 07032025 21159305 Nombre de photos uploadées : 22 / 23040 (0%) 07032025 21159305 Nombre de photos taguées (types de déchets): 0 / 22 (0%) 07032025 21159305 Nombre de photos taguées (volume) : 0 / 22 (0%) elapsed_time : load_data_split_time_score 3.337860107421875e-06 elapsed_time : order_list_meta_photo_and_scores 1.7404556274414062e-05 ?????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0014574527740478516 elapsed_time : insert_dashboard_record_day_entry 0.04927945137023926 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21137165 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21137166 order by id desc limit 1 Qualite : 0.06901780564613035 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21137167_07-03-2025_09_30_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21137167 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21137167 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21137168 order by id desc limit 1 Qualite : 0.31035864228901067 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21137169_07-03-2025_09_45_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21137169 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21137169 AND mptpi.`type`=4200 To do Qualite : 0.12029958453427352 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21137170_07-03-2025_10_12_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21137170 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21137170 AND mptpi.`type`=3327 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21144562 order by id desc limit 1 Qualite : 0.07653079042292898 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21139330_07-03-2025_15_04_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21139330 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21139330 AND mptpi.`type`=4207 To do Qualite : 0.20875828340595504 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21139331_07-03-2025_11_39_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21139331 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21139331 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21139332 order by id desc limit 1 Qualite : 0.26713232457334796 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21139333_07-03-2025_11_10_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21139333 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21139333 AND mptpi.`type`=3594 To do Qualite : 0.10974511151393432 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21139334_07-03-2025_11_15_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21139334 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21139334 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21144563 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21144564 order by id desc limit 1 Qualite : 0.09914263658308704 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21144566_07-03-2025_19_49_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21144566 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21144566 AND mptpi.`type`=4207 To do Qualite : 0.056704727727536576 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21144567_07-03-2025_19_25_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21144567 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21144567 AND mptpi.`type`=4207 To do Qualite : 0.07085944388843439 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21144568_07-03-2025_17_37_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21144568 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21144568 AND mptpi.`type`=4207 To do Qualite : 0.06787673922158989 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21144569_07-03-2025_16_35_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21144569 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21144569 AND mptpi.`type`=4207 To do Qualite : 0.02990633526612963 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21144582_07-03-2025_19_59_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21144582 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21144582 AND mptpi.`type`=4211 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21144583 order by id desc limit 1 Qualite : 0.08463218860037304 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21144584_07-03-2025_15_34_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21144584 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21144584 AND mptpi.`type`=3726 To do Qualite : 0.186235652970679 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21151138_07-03-2025_18_35_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21151138 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21151138 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21144586 order by id desc limit 1 Qualite : 0.048007199595548555 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21144587_07-03-2025_15_31_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21144587 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21144587 AND mptpi.`type`=4207 To do Qualite : 0.10470139090045394 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21144588_07-03-2025_16_27_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21144588 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21144588 AND mptpi.`type`=4207 To do Qualite : 0.13569747242583838 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21147310_07-03-2025_20_21_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21147310 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21147310 AND mptpi.`type`=3327 To do Qualite : 0.2686763564176468 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21147311_07-03-2025_17_44_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21147311 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21147311 AND mptpi.`type`=4200 To do Qualite : 0.0750740438276186 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21151139_07-03-2025_19_20_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21151139 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21151139 AND mptpi.`type`=4207 To do Qualite : 0.22099247483369353 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21151140_07-03-2025_17_59_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21151140 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21151140 AND mptpi.`type`=3726 To do Qualite : 0.063893594666435 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21151141_07-03-2025_18_01_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21151141 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21151141 AND mptpi.`type`=4207 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21151142_07-03-2025_18_08_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21151142 order by id desc limit 1 Qualite : 0.26515683070613866 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21151143_07-03-2025_18_27_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21151143 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21151143 AND mptpi.`type`=3594 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21151144_07-03-2025_18_02_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21151144 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21159285 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21159286 order by id desc limit 1 Qualite : 0.06210775486134715 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21159287_07-03-2025_20_57_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21159287 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21159287 AND mptpi.`type`=4207 To do Qualite : 0.11123380209136985 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21159305_07-03-2025_20_58_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21159305 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21159305 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21159306 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21159307 order by id desc limit 1 Qualite : 0.048392844995173476 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21159308_07-03-2025_20_56_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21159308 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21159308 AND mptpi.`type`=4207 To do Qualite : 0.04104244061097395 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21159309_07-03-2025_20_52_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21159309 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21159309 AND mptpi.`type`=4207 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'07032025': {'nb_upload': 22, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1341536338, 1341535845, 1341535549, 1341535518, 1341535480, 1341535473, 1341535454, 1341535276, 1341535250, 1341522613] Looping around the photos to save general results len do output : 1 /21159305Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341536338', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535845', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535549', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535518', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535480', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535473', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535454', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535276', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341535250', None, None, None, None, None, '2649742') ('3459', None, None, None, None, None, None, None, '2649742') ('3459', '21159305', '1341522613', None, None, None, None, None, '2649742') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.01474142074584961 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.940596342086792 time spend to save output : 0.014971494674682617 total time spend for step 11 : 12.955567836761475 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 184.44user 162.44system 6:40.28elapsed 86%CPU (0avgtext+0avgdata 4625080maxresident)k 636768inputs+149864outputs (2614major+14181354minor)pagefaults 0swaps