python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3490722 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2535626'] with mtr_portfolio_ids : ['20124876'] and first list_photo_ids : [] new path : /proc/3490722/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 2 ; length of list_pids : 2 ; length of list_args : 2 time to download the photos : 0.33274245262145996 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Sat Feb 1 06:20:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3378 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-01 06:20:33.972043: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-01 06:20:34.003558: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493020000 Hz 2025-02-01 06:20:34.005977: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f1ba8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-01 06:20:34.006019: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-01 06:20:34.009698: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-01 06:20:34.283828: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x22ac4810 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-01 06:20:34.283899: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-01 06:20:34.285125: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 06:20:34.287089: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 06:20:34.302438: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 06:20:34.307291: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 06:20:34.311382: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 06:20:34.316007: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 06:20:34.317799: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 06:20:34.326169: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 06:20:34.327641: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 06:20:34.327772: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 06:20:34.328463: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 06:20:34.328483: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 06:20:34.328494: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 06:20:34.329487: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2926 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-01 06:20:34.644151: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 06:20:34.644264: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 06:20:34.644288: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 06:20:34.644310: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 06:20:34.644331: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 06:20:34.644351: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 06:20:34.644371: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 06:20:34.644392: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 06:20:34.645471: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 06:20:34.646624: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 06:20:34.646664: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 06:20:34.646681: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 06:20:34.646695: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 06:20:34.646709: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 06:20:34.646722: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 06:20:34.646736: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 06:20:34.646750: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 06:20:34.647618: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 06:20:34.647649: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 06:20:34.647658: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 06:20:34.647666: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 06:20:34.648571: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2926 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-01 06:20:42.356077: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 06:20:42.544873: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 06:20:44.018538: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.019579: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.12G (2279905536 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.019633: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 06:20:44.020689: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.020717: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 06:20:44.028335: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.028358: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 06:20:44.028946: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.028960: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 06:20:44.035555: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.035580: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 06:20:44.036210: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.036226: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 06:20:44.067719: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.067781: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 06:20:44.068430: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.068447: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 06:20:44.074414: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.074455: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 06:20:44.075088: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.075106: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 06:20:44.110316: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.111021: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.113069: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.113731: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.153170: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.153899: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.156361: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.157076: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.184479: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.185174: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.186909: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.187595: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.193684: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.194368: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.196223: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.196882: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.203093: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.203818: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.205516: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.206172: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.236101: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.236823: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.237488: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.238146: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.242114: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.242789: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.260104: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.260794: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.261446: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.262088: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.275586: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.276310: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.277006: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.277681: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.282524: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.283210: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.288344: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.289037: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.302245: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.303118: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.307879: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.308718: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.309382: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.310017: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.310954: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.311611: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.322426: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.323370: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.324047: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.324698: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.325348: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.326002: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.342054: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.343308: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.395398: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.396167: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.396861: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.397511: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.405896: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.406591: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.424493: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.425653: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.426741: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.427867: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.432705: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.433729: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.434810: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.435765: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.437079: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.437100: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-02-01 06:20:44.447816: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.448638: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.457865: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.458560: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.459246: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.459939: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.460616: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 06:20:44.461285: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.36G (2533228544 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 2 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.42266 max: 149.34219 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 9.369850158691406e-05 nb_pixel_total : 44 time to create 1 rle with old method : 0.0001964569091796875 length of segment : 19 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 300 time to create 1 rle with old method : 0.0006206035614013672 length of segment : 35 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 65 time to create 1 rle with old method : 0.00017213821411132812 length of segment : 12 time for calcul the mask position with numpy : 0.0003020763397216797 nb_pixel_total : 4340 time to create 1 rle with old method : 0.012891769409179688 length of segment : 196 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.0001575946807861328 length of segment : 26 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 1 time to create 1 rle with old method : 2.4557113647460938e-05 length of segment : 1 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 52 time to create 1 rle with old method : 9.918212890625e-05 length of segment : 11 length of segment : 0 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.000164031982421875 length of segment : 26 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00022077560424804688 length of segment : 24 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 123 time to create 1 rle with old method : 0.00021910667419433594 length of segment : 25 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.00020074844360351562 length of segment : 25 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.34453 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 9.512901306152344e-05 nb_pixel_total : 2336 time to create 1 rle with old method : 0.003996133804321289 length of segment : 53 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.00021719932556152344 length of segment : 14 time for calcul the mask position with numpy : 0.00045228004455566406 nb_pixel_total : 17360 time to create 1 rle with old method : 0.02476024627685547 length of segment : 455 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.88359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 0.00012993812561035156 nb_pixel_total : 6375 time to create 1 rle with old method : 0.008401632308959961 length of segment : 101 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 954 time to create 1 rle with old method : 0.0016903877258300781 length of segment : 45 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 394 time to create 1 rle with old method : 0.0005812644958496094 length of segment : 22 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.0006275177001953125 length of segment : 17 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.00024771690368652344 length of segment : 21 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 539 time to create 1 rle with old method : 0.0008213520050048828 length of segment : 28 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.0003314018249511719 length of segment : 38 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 533 time to create 1 rle with old method : 0.001161813735961914 length of segment : 41 time for calcul the mask position with numpy : 9.393692016601562e-05 nb_pixel_total : 284 time to create 1 rle with old method : 0.0009667873382568359 length of segment : 13 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.61406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002944469451904297 length of segment : 14 time for calcul the mask position with numpy : 0.0001518726348876953 nb_pixel_total : 7647 time to create 1 rle with old method : 0.008860349655151367 length of segment : 126 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.12344 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 83 time to create 1 rle with old method : 0.0001697540283203125 length of segment : 9 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0006556510925292969 length of segment : 17 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 2561 time to create 1 rle with old method : 0.0028362274169921875 length of segment : 198 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 472 time to create 1 rle with old method : 0.0006487369537353516 length of segment : 17 time for calcul the mask position with numpy : 0.0004937648773193359 nb_pixel_total : 42603 time to create 1 rle with old method : 0.04693794250488281 length of segment : 230 time for calcul the mask position with numpy : 0.0007166862487792969 nb_pixel_total : 52673 time to create 1 rle with old method : 0.057521820068359375 length of segment : 231 Processing 1 images image shape: (400, 400, 3) min: 19.00000 max: 254.00000 molded_images shape: (1, 640, 640, 3) min: -83.98906 max: 109.35234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -107.22344 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.0003097057342529297 length of segment : 14 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 68 time to create 1 rle with old method : 0.00025725364685058594 length of segment : 9 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 1208 time to create 1 rle with old method : 0.0016088485717773438 length of segment : 40 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.0001888275146484375 length of segment : 15 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 1418 time to create 1 rle with old method : 0.0017058849334716797 length of segment : 47 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.0003657341003417969 length of segment : 11 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 1997 time to create 1 rle with old method : 0.0024619102478027344 length of segment : 39 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.00024580955505371094 length of segment : 16 time for calcul the mask position with numpy : 0.0002422332763671875 nb_pixel_total : 7780 time to create 1 rle with old method : 0.009342193603515625 length of segment : 157 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 1743 time to create 1 rle with old method : 0.0023305416107177734 length of segment : 35 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 259 time to create 1 rle with old method : 0.0003521442413330078 length of segment : 31 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.00037360191345214844 length of segment : 18 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.00038433074951171875 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.74297 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 19 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.00029468536376953125 length of segment : 17 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 144 time to create 1 rle with old method : 0.0002460479736328125 length of segment : 10 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 268 time to create 1 rle with old method : 0.0004138946533203125 length of segment : 14 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1066 time to create 1 rle with old method : 0.0013442039489746094 length of segment : 58 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 305 time to create 1 rle with old method : 0.0003943443298339844 length of segment : 32 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.00027823448181152344 length of segment : 18 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.00028586387634277344 length of segment : 13 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003552436828613281 length of segment : 18 time for calcul the mask position with numpy : 0.00020742416381835938 nb_pixel_total : 5388 time to create 1 rle with old method : 0.006655693054199219 length of segment : 297 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 959 time to create 1 rle with old method : 0.0012431144714355469 length of segment : 54 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 1027 time to create 1 rle with old method : 0.001348257064819336 length of segment : 37 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 228 time to create 1 rle with old method : 0.0003151893615722656 length of segment : 17 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 783 time to create 1 rle with old method : 0.0009834766387939453 length of segment : 37 time for calcul the mask position with numpy : 0.00019931793212890625 nb_pixel_total : 6677 time to create 1 rle with old method : 0.008171558380126953 length of segment : 285 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 654 time to create 1 rle with old method : 0.0010290145874023438 length of segment : 31 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1054 time to create 1 rle with old method : 0.0014896392822265625 length of segment : 36 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 822 time to create 1 rle with old method : 0.0010519027709960938 length of segment : 40 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.0002925395965576172 length of segment : 13 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 166 time to create 1 rle with old method : 0.0002675056457519531 length of segment : 12 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.52422 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 0.0002658367156982422 nb_pixel_total : 7887 time to create 1 rle with old method : 0.010181427001953125 length of segment : 158 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 921 time to create 1 rle with old method : 0.0012977123260498047 length of segment : 44 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 508 time to create 1 rle with old method : 0.0006606578826904297 length of segment : 50 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 1444 time to create 1 rle with old method : 0.0018587112426757812 length of segment : 30 time for calcul the mask position with numpy : 0.00015306472778320312 nb_pixel_total : 7389 time to create 1 rle with old method : 0.008486270904541016 length of segment : 133 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.0002872943878173828 length of segment : 36 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 2216 time to create 1 rle with old method : 0.0025548934936523438 length of segment : 73 time for calcul the mask position with numpy : 0.0003485679626464844 nb_pixel_total : 11914 time to create 1 rle with old method : 0.013235807418823242 length of segment : 278 time for calcul the mask position with numpy : 0.00010323524475097656 nb_pixel_total : 2067 time to create 1 rle with old method : 0.0025835037231445312 length of segment : 139 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1715 time to create 1 rle with old method : 0.0021958351135253906 length of segment : 33 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.00025844573974609375 length of segment : 12 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 647 time to create 1 rle with old method : 0.0008502006530761719 length of segment : 37 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1451 time to create 1 rle with old method : 0.0018391609191894531 length of segment : 42 time for calcul the mask position with numpy : 0.00014495849609375 nb_pixel_total : 7148 time to create 1 rle with old method : 0.008483648300170898 length of segment : 128 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.85391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 1051 time to create 1 rle with old method : 0.0014796257019042969 length of segment : 28 time for calcul the mask position with numpy : 0.00016808509826660156 nb_pixel_total : 4166 time to create 1 rle with old method : 0.004853487014770508 length of segment : 217 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 873 time to create 1 rle with old method : 0.0010743141174316406 length of segment : 47 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1582 time to create 1 rle with old method : 0.0018756389617919922 length of segment : 76 time for calcul the mask position with numpy : 0.0001628398895263672 nb_pixel_total : 2112 time to create 1 rle with old method : 0.0026884078979492188 length of segment : 58 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 68 time to create 1 rle with old method : 0.00012135505676269531 length of segment : 13 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 10 time to create 1 rle with old method : 3.5762786865234375e-05 length of segment : 4 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001678466796875 length of segment : 14 Processing 1 images image shape: (280, 400, 3) min: 15.00000 max: 216.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 83.17656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.000978708267211914 nb_pixel_total : 106323 time to create 1 rle with old method : 0.12057733535766602 length of segment : 282 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 514 time to create 1 rle with old method : 0.0007171630859375 length of segment : 59 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 673 time to create 1 rle with old method : 0.0008714199066162109 length of segment : 37 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 1571 time to create 1 rle with old method : 0.00183868408203125 length of segment : 79 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 215 time to create 1 rle with old method : 0.0002925395965576172 length of segment : 24 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.0001418590545654297 length of segment : 10 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003592967987060547 length of segment : 36 time for calcul the mask position with numpy : 9.059906005859375e-05 nb_pixel_total : 2665 time to create 1 rle with old method : 0.003261566162109375 length of segment : 87 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1295 time to create 1 rle with old method : 0.0016183853149414062 length of segment : 35 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 442 time to create 1 rle with old method : 0.0005967617034912109 length of segment : 51 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1104 time to create 1 rle with old method : 0.0014841556549072266 length of segment : 43 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 426 time to create 1 rle with old method : 0.0005929470062255859 length of segment : 51 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 506 time to create 1 rle with old method : 0.0007038116455078125 length of segment : 31 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003905296325683594 length of segment : 13 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1313 time to create 1 rle with old method : 0.0017240047454833984 length of segment : 36 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 558 time to create 1 rle with old method : 0.0007605552673339844 length of segment : 51 time for calcul the mask position with numpy : 9.226799011230469e-05 nb_pixel_total : 3735 time to create 1 rle with old method : 0.004332780838012695 length of segment : 95 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.0002269744873046875 length of segment : 15 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.07266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 26 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 485 time to create 1 rle with old method : 0.0006575584411621094 length of segment : 33 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 1314 time to create 1 rle with old method : 0.0016624927520751953 length of segment : 49 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.00018668174743652344 length of segment : 16 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 219 time to create 1 rle with old method : 0.0002932548522949219 length of segment : 22 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 43 time to create 1 rle with old method : 9.107589721679688e-05 length of segment : 6 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.0003180503845214844 length of segment : 14 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.0001697540283203125 length of segment : 12 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 2903 time to create 1 rle with old method : 0.003497600555419922 length of segment : 40 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.0002772808074951172 length of segment : 19 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 505 time to create 1 rle with old method : 0.0007100105285644531 length of segment : 17 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 954 time to create 1 rle with old method : 0.0011529922485351562 length of segment : 40 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 859 time to create 1 rle with old method : 0.0010919570922851562 length of segment : 35 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 509 time to create 1 rle with old method : 0.0006940364837646484 length of segment : 20 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 1130 time to create 1 rle with old method : 0.0013709068298339844 length of segment : 50 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 359 time to create 1 rle with old method : 0.0004792213439941406 length of segment : 32 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.00031948089599609375 length of segment : 19 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 119 time to create 1 rle with old method : 0.00018906593322753906 length of segment : 11 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.00034499168395996094 length of segment : 31 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.00034499168395996094 length of segment : 23 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 572 time to create 1 rle with old method : 0.0007464885711669922 length of segment : 26 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 1392 time to create 1 rle with old method : 0.0017223358154296875 length of segment : 62 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.00039958953857421875 length of segment : 13 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.00016689300537109375 length of segment : 11 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.0001404285430908203 length of segment : 16 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 1788 time to create 1 rle with old method : 0.002118825912475586 length of segment : 87 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 1602 time to create 1 rle with old method : 0.0019137859344482422 length of segment : 95 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.04922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 30 time for calcul the mask position with numpy : 9.632110595703125e-05 nb_pixel_total : 456 time to create 1 rle with old method : 0.0010762214660644531 length of segment : 26 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 25 time to create 1 rle with old method : 0.00012993812561035156 length of segment : 15 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 91 time to create 1 rle with old method : 0.0001544952392578125 length of segment : 14 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 500 time to create 1 rle with old method : 0.0006582736968994141 length of segment : 34 time for calcul the mask position with numpy : 0.0003123283386230469 nb_pixel_total : 5019 time to create 1 rle with old method : 0.0059053897857666016 length of segment : 208 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 529 time to create 1 rle with old method : 0.0007135868072509766 length of segment : 30 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.00014543533325195312 length of segment : 13 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.0003981590270996094 length of segment : 25 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 22 time to create 1 rle with old method : 7.843971252441406e-05 length of segment : 6 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.0005207061767578125 length of segment : 24 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 460 time to create 1 rle with old method : 0.0006453990936279297 length of segment : 32 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.00022029876708984375 length of segment : 11 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 111 time to create 1 rle with old method : 0.00018644332885742188 length of segment : 13 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 421 time to create 1 rle with old method : 0.0006020069122314453 length of segment : 24 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004851818084716797 length of segment : 33 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1041 time to create 1 rle with old method : 0.0013811588287353516 length of segment : 39 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 364 time to create 1 rle with old method : 0.0005142688751220703 length of segment : 22 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 55 time to create 1 rle with old method : 0.00012993812561035156 length of segment : 6 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.0005090236663818359 length of segment : 30 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.00040459632873535156 length of segment : 22 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.0001461505889892578 length of segment : 13 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.0001621246337890625 length of segment : 20 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.0001938343048095703 length of segment : 25 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 24 time to create 1 rle with old method : 6.151199340820312e-05 length of segment : 7 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 343 time to create 1 rle with old method : 0.0005087852478027344 length of segment : 36 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.0004253387451171875 length of segment : 18 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 529 time to create 1 rle with old method : 0.0006763935089111328 length of segment : 42 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.0002205371856689453 length of segment : 14 time for calcul the mask position with numpy : 0.0002884864807128906 nb_pixel_total : 2458 time to create 1 rle with old method : 0.0030777454376220703 length of segment : 137 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 396 time to create 1 rle with old method : 0.0005586147308349609 length of segment : 34 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 132.47500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 186 time to create 1 rle with old method : 0.00031280517578125 length of segment : 34 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 1813 time to create 1 rle with old method : 0.0022454261779785156 length of segment : 56 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 544 time to create 1 rle with old method : 0.0007205009460449219 length of segment : 41 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.00014138221740722656 length of segment : 9 time for calcul the mask position with numpy : 0.0004930496215820312 nb_pixel_total : 43712 time to create 1 rle with old method : 0.04829287528991699 length of segment : 263 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 11 time to create 1 rle with old method : 5.602836608886719e-05 length of segment : 6 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.16875 max: 147.96328 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 23 time to create 1 rle with old method : 6.699562072753906e-05 length of segment : 9 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0005259513854980469 length of segment : 27 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 88 time to create 1 rle with old method : 0.00013303756713867188 length of segment : 25 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 1932 time to create 1 rle with old method : 0.002329587936401367 length of segment : 97 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.0001704692840576172 length of segment : 19 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.48906 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 1980 time to create 1 rle with old method : 0.0034275054931640625 length of segment : 47 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 872 time to create 1 rle with old method : 0.001554727554321289 length of segment : 47 time for calcul the mask position with numpy : 0.0003268718719482422 nb_pixel_total : 7571 time to create 1 rle with old method : 0.01289057731628418 length of segment : 300 time for calcul the mask position with numpy : 8.320808410644531e-05 nb_pixel_total : 2640 time to create 1 rle with old method : 0.0031380653381347656 length of segment : 55 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.59844 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 0.00011205673217773438 nb_pixel_total : 7000 time to create 1 rle with old method : 0.00799703598022461 length of segment : 105 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 928 time to create 1 rle with old method : 0.0012052059173583984 length of segment : 45 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 514 time to create 1 rle with old method : 0.0006899833679199219 length of segment : 26 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 727 time to create 1 rle with old method : 0.00084686279296875 length of segment : 44 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 432 time to create 1 rle with old method : 0.0006160736083984375 length of segment : 22 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 442 time to create 1 rle with old method : 0.0006055831909179688 length of segment : 22 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.00015854835510253906 length of segment : 7 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 410 time to create 1 rle with old method : 0.0006167888641357422 length of segment : 17 time for calcul the mask position with numpy : 0.0001437664031982422 nb_pixel_total : 1958 time to create 1 rle with old method : 0.0025849342346191406 length of segment : 81 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.87969 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 203 time to create 1 rle with old method : 0.00036978721618652344 length of segment : 15 time for calcul the mask position with numpy : 0.0001232624053955078 nb_pixel_total : 6844 time to create 1 rle with old method : 0.008088827133178711 length of segment : 105 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.11562 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 9.441375732421875e-05 nb_pixel_total : 2744 time to create 1 rle with old method : 0.003144502639770508 length of segment : 231 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1022 time to create 1 rle with old method : 0.00131988525390625 length of segment : 32 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 517 time to create 1 rle with old method : 0.0007092952728271484 length of segment : 18 time for calcul the mask position with numpy : 0.0004582405090332031 nb_pixel_total : 40720 time to create 1 rle with old method : 0.04499697685241699 length of segment : 198 time for calcul the mask position with numpy : 0.00011682510375976562 nb_pixel_total : 2067 time to create 1 rle with old method : 0.0032744407653808594 length of segment : 51 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 500 time to create 1 rle with old method : 0.0007863044738769531 length of segment : 19 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 857 time to create 1 rle with old method : 0.0010826587677001953 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 19.00000 max: 253.00000 molded_images shape: (1, 640, 640, 3) min: -83.02422 max: 110.86016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0012907981872558594 nb_pixel_total : 153076 time to create 1 rle with new method : 0.002118349075317383 length of segment : 395 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -106.86016 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.0002980232238769531 length of segment : 14 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 61 time to create 1 rle with old method : 0.000125885009765625 length of segment : 9 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.00015544891357421875 length of segment : 18 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1107 time to create 1 rle with old method : 0.0014195442199707031 length of segment : 40 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 306 time to create 1 rle with old method : 0.00043129920959472656 length of segment : 14 time for calcul the mask position with numpy : 0.0003578662872314453 nb_pixel_total : 20214 time to create 1 rle with old method : 0.024425268173217773 length of segment : 132 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.0004665851593017578 length of segment : 20 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 144 time to create 1 rle with old method : 0.000225067138671875 length of segment : 16 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.00021886825561523438 length of segment : 12 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 1108 time to create 1 rle with old method : 0.001537322998046875 length of segment : 53 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1985 time to create 1 rle with old method : 0.0028505325317382812 length of segment : 41 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.54375 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 394 time to create 1 rle with old method : 0.0005650520324707031 length of segment : 18 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 470 time to create 1 rle with old method : 0.0008666515350341797 length of segment : 19 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.00032258033752441406 length of segment : 17 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.00032711029052734375 length of segment : 14 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 779 time to create 1 rle with old method : 0.0009889602661132812 length of segment : 35 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.00014519691467285156 length of segment : 11 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.00030612945556640625 length of segment : 30 time for calcul the mask position with numpy : 0.00033020973205566406 nb_pixel_total : 17706 time to create 1 rle with old method : 0.026662826538085938 length of segment : 350 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.0002124309539794922 length of segment : 15 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0003845691680908203 length of segment : 24 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.00016045570373535156 length of segment : 9 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1327 time to create 1 rle with old method : 0.0015981197357177734 length of segment : 54 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.0002536773681640625 length of segment : 11 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.00018835067749023438 length of segment : 11 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 654 time to create 1 rle with old method : 0.0008599758148193359 length of segment : 29 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 2243 time to create 1 rle with old method : 0.002848386764526367 length of segment : 75 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.63359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 8.869171142578125e-05 nb_pixel_total : 607 time to create 1 rle with old method : 0.0013158321380615234 length of segment : 36 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1476 time to create 1 rle with old method : 0.0019061565399169922 length of segment : 43 time for calcul the mask position with numpy : 8.463859558105469e-05 nb_pixel_total : 2752 time to create 1 rle with old method : 0.004181623458862305 length of segment : 30 time for calcul the mask position with numpy : 0.0001010894775390625 nb_pixel_total : 1281 time to create 1 rle with old method : 0.0019118785858154297 length of segment : 44 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 373 time to create 1 rle with old method : 0.0005056858062744141 length of segment : 24 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.0003306865692138672 length of segment : 11 time for calcul the mask position with numpy : 0.00019598007202148438 nb_pixel_total : 6133 time to create 1 rle with old method : 0.007563352584838867 length of segment : 125 time for calcul the mask position with numpy : 0.000152587890625 nb_pixel_total : 4131 time to create 1 rle with old method : 0.005666971206665039 length of segment : 164 time for calcul the mask position with numpy : 0.0001811981201171875 nb_pixel_total : 7668 time to create 1 rle with old method : 0.010066509246826172 length of segment : 143 time for calcul the mask position with numpy : 0.00010037422180175781 nb_pixel_total : 2669 time to create 1 rle with old method : 0.0039598941802978516 length of segment : 67 time for calcul the mask position with numpy : 0.00012874603271484375 nb_pixel_total : 2454 time to create 1 rle with old method : 0.0034759044647216797 length of segment : 77 time for calcul the mask position with numpy : 0.00014925003051757812 nb_pixel_total : 2004 time to create 1 rle with old method : 0.0028374195098876953 length of segment : 145 time for calcul the mask position with numpy : 0.000171661376953125 nb_pixel_total : 7058 time to create 1 rle with old method : 0.009112358093261719 length of segment : 145 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.74844 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1057 time to create 1 rle with old method : 0.0015740394592285156 length of segment : 29 time for calcul the mask position with numpy : 0.000209808349609375 nb_pixel_total : 4561 time to create 1 rle with old method : 0.005579233169555664 length of segment : 218 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 719 time to create 1 rle with old method : 0.0009446144104003906 length of segment : 45 time for calcul the mask position with numpy : 0.0001647472381591797 nb_pixel_total : 2200 time to create 1 rle with old method : 0.0030138492584228516 length of segment : 44 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 1712 time to create 1 rle with old method : 0.0020737648010253906 length of segment : 82 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 46 time to create 1 rle with old method : 9.131431579589844e-05 length of segment : 13 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 478 time to create 1 rle with old method : 0.0006215572357177734 length of segment : 44 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 661 time to create 1 rle with old method : 0.0008587837219238281 length of segment : 51 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.0004451274871826172 length of segment : 23 Processing 1 images image shape: (280, 400, 3) min: 14.00000 max: 219.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 86.78984 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 540 time to create 1 rle with old method : 0.0008039474487304688 length of segment : 51 time for calcul the mask position with numpy : 0.0010156631469726562 nb_pixel_total : 105248 time to create 1 rle with old method : 0.12485218048095703 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 638 time to create 1 rle with old method : 0.0008013248443603516 length of segment : 34 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1544 time to create 1 rle with old method : 0.0018038749694824219 length of segment : 82 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 424 time to create 1 rle with old method : 0.0006785392761230469 length of segment : 51 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 1302 time to create 1 rle with old method : 0.0017666816711425781 length of segment : 47 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 945 time to create 1 rle with old method : 0.0014026165008544922 length of segment : 44 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1296 time to create 1 rle with old method : 0.0018393993377685547 length of segment : 38 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 690 time to create 1 rle with old method : 0.0009469985961914062 length of segment : 36 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0003714561462402344 length of segment : 37 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 83 time to create 1 rle with old method : 0.0001494884490966797 length of segment : 10 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.00028133392333984375 length of segment : 25 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 444 time to create 1 rle with old method : 0.0006654262542724609 length of segment : 51 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 39 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.00022220611572265625 length of segment : 11 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00016307830810546875 length of segment : 12 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1400 time to create 1 rle with old method : 0.0017743110656738281 length of segment : 48 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 1366 time to create 1 rle with old method : 0.0017311573028564453 length of segment : 42 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 355 time to create 1 rle with old method : 0.0004756450653076172 length of segment : 29 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.00025153160095214844 length of segment : 20 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.0004172325134277344 length of segment : 23 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.0002276897430419922 length of segment : 12 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1512 time to create 1 rle with old method : 0.001800537109375 length of segment : 86 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 2469 time to create 1 rle with old method : 0.0030765533447265625 length of segment : 32 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.0001823902130126953 length of segment : 14 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.0007026195526123047 length of segment : 26 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.00016427040100097656 length of segment : 10 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 506 time to create 1 rle with old method : 0.0006856918334960938 length of segment : 29 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 40 time to create 1 rle with old method : 8.678436279296875e-05 length of segment : 6 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 63 time to create 1 rle with old method : 0.0001270771026611328 length of segment : 8 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.00033664703369140625 length of segment : 24 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.00024247169494628906 length of segment : 21 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.00025177001953125 length of segment : 17 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.0003185272216796875 length of segment : 22 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 42 time to create 1 rle with old method : 8.869171142578125e-05 length of segment : 5 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 46 time to create 1 rle with old method : 9.5367431640625e-05 length of segment : 7 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 1851 time to create 1 rle with old method : 0.0023670196533203125 length of segment : 30 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 186 time to create 1 rle with old method : 0.00027561187744140625 length of segment : 13 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 524 time to create 1 rle with old method : 0.0007288455963134766 length of segment : 46 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 127 time to create 1 rle with old method : 0.00021910667419433594 length of segment : 22 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.00023365020751953125 length of segment : 17 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 120 time to create 1 rle with old method : 0.00020170211791992188 length of segment : 8 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0003898143768310547 length of segment : 15 length of segment : 0 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 690 time to create 1 rle with old method : 0.0008828639984130859 length of segment : 33 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 75 time to create 1 rle with old method : 0.0001494884490966797 length of segment : 6 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 380 time to create 1 rle with old method : 0.0005056858062744141 length of segment : 27 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 52 time to create 1 rle with old method : 9.942054748535156e-05 length of segment : 10 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 155 time to create 1 rle with old method : 0.0002243518829345703 length of segment : 18 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.00016117095947265625 length of segment : 8 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.0001494884490966797 length of segment : 13 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 512 time to create 1 rle with old method : 0.0006456375122070312 length of segment : 31 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.00030040740966796875 length of segment : 19 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.14297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 495 time to create 1 rle with old method : 0.0006892681121826172 length of segment : 35 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 455 time to create 1 rle with old method : 0.0006246566772460938 length of segment : 25 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.0005371570587158203 length of segment : 34 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 499 time to create 1 rle with old method : 0.0006887912750244141 length of segment : 35 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0003616809844970703 length of segment : 35 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 547 time to create 1 rle with old method : 0.0007565021514892578 length of segment : 72 time for calcul the mask position with numpy : 0.00027680397033691406 nb_pixel_total : 5904 time to create 1 rle with old method : 0.007101297378540039 length of segment : 221 time for calcul the mask position with numpy : 9.965896606445312e-05 nb_pixel_total : 100 time to create 1 rle with old method : 0.0002923011779785156 length of segment : 16 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 458 time to create 1 rle with old method : 0.0011277198791503906 length of segment : 20 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006213188171386719 length of segment : 43 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.00037980079650878906 length of segment : 22 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 671 time to create 1 rle with old method : 0.0008864402770996094 length of segment : 37 time for calcul the mask position with numpy : 8.440017700195312e-05 nb_pixel_total : 111 time to create 1 rle with old method : 0.00022554397583007812 length of segment : 25 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.0003457069396972656 length of segment : 22 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 351 time to create 1 rle with old method : 0.0005209445953369141 length of segment : 22 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 132.03750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0006818771362304688 length of segment : 25 time for calcul the mask position with numpy : 0.00011324882507324219 nb_pixel_total : 1375 time to create 1 rle with old method : 0.0031452178955078125 length of segment : 60 time for calcul the mask position with numpy : 0.00012254714965820312 nb_pixel_total : 384 time to create 1 rle with old method : 0.0005614757537841797 length of segment : 24 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.0003635883331298828 length of segment : 18 time for calcul the mask position with numpy : 8.654594421386719e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.00043964385986328125 length of segment : 43 time for calcul the mask position with numpy : 7.724761962890625e-05 nb_pixel_total : 22 time to create 1 rle with old method : 0.00011587142944335938 length of segment : 8 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1344 time to create 1 rle with old method : 0.0017032623291015625 length of segment : 58 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 77 time to create 1 rle with old method : 0.00015497207641601562 length of segment : 10 Detection mask done ! Trying to reset tf kernel 3490976 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1386 tf kernel not reseted sub process len(results) : 318 len(list_Values) 318 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 318 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2579 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 318 chid ids of type : 4228 Number RLEs to save : 15759 save missing photos in datou_result : time spend for datou_step_exec : 23.709609031677246 time spend to save output : 1.8885324001312256 total time spend for step 1 : 25.59814143180847 step2:brightness Sat Feb 1 06:20:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1738387230_3490722_1333477138_eb7aba6b2e7d5b8e0489fbe268b2f96c.jpg treat image : temp/1738387230_3490722_1333476998_685a3a45ff5c5fd1cc015311f2ef7543.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.013525247573852539 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.014074563980102539 save missing photos in datou_result : time spend for datou_step_exec : 0.5392262935638428 time spend to save output : 0.03171586990356445 total time spend for step 2 : 0.5709421634674072 step3:blur_detection Sat Feb 1 06:20:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1738387230_3490722_1333477138_eb7aba6b2e7d5b8e0489fbe268b2f96c.jpg resize: (1080, 1920) 1333477138 -8.217034253533944 treat image : temp/1738387230_3490722_1333476998_685a3a45ff5c5fd1cc015311f2ef7543.jpg resize: (1080, 1920) 1333476998 -8.201524784966612 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.015669584274291992 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.01373744010925293 save missing photos in datou_result : time spend for datou_step_exec : 1.6556224822998047 time spend to save output : 0.03480362892150879 total time spend for step 3 : 1.6904261112213135 step4:rle_unique_nms_with_priority Sat Feb 1 06:20:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 318 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 165 nb_hashtags : 7 time to prepare the origin masks : 1.0875129699707031 time for calcul the mask position with numpy : 0.05644369125366211 nb_pixel_total : 1706993 time to create 1 rle with new method : 1.0799322128295898 time for calcul the mask position with numpy : 0.009160757064819336 nb_pixel_total : 2561 time to create 1 rle with old method : 0.0030319690704345703 time for calcul the mask position with numpy : 0.009115934371948242 nb_pixel_total : 42603 time to create 1 rle with old method : 0.04564857482910156 time for calcul the mask position with numpy : 0.00893545150756836 nb_pixel_total : 28 time to create 1 rle with old method : 9.942054748535156e-05 time for calcul the mask position with numpy : 0.008440732955932617 nb_pixel_total : 42 time to create 1 rle with old method : 6.508827209472656e-05 time for calcul the mask position with numpy : 0.00869131088256836 nb_pixel_total : 96 time to create 1 rle with old method : 0.00012254714965820312 time for calcul the mask position with numpy : 0.009910345077514648 nb_pixel_total : 300 time to create 1 rle with old method : 0.0004425048828125 time for calcul the mask position with numpy : 0.008591413497924805 nb_pixel_total : 44 time to create 1 rle with old method : 5.8650970458984375e-05 time for calcul the mask position with numpy : 0.008517980575561523 nb_pixel_total : 57 time to create 1 rle with old method : 8.034706115722656e-05 time for calcul the mask position with numpy : 0.008557558059692383 nb_pixel_total : 52 time to create 1 rle with old method : 8.296966552734375e-05 time for calcul the mask position with numpy : 0.009155511856079102 nb_pixel_total : 12 time to create 1 rle with old method : 7.963180541992188e-05 time for calcul the mask position with numpy : 0.01091909408569336 nb_pixel_total : 12664 time to create 1 rle with old method : 0.014987945556640625 time for calcul the mask position with numpy : 0.008817434310913086 nb_pixel_total : 2336 time to create 1 rle with old method : 0.0026781558990478516 time for calcul the mask position with numpy : 0.008779764175415039 nb_pixel_total : 1 time to create 1 rle with old method : 2.2411346435546875e-05 time for calcul the mask position with numpy : 0.00872945785522461 nb_pixel_total : 17360 time to create 1 rle with old method : 0.01896214485168457 time for calcul the mask position with numpy : 0.008744001388549805 nb_pixel_total : 954 time to create 1 rle with old method : 0.0010907649993896484 time for calcul the mask position with numpy : 0.008642435073852539 nb_pixel_total : 174 time to create 1 rle with old method : 0.00022745132446289062 time for calcul the mask position with numpy : 0.00860738754272461 nb_pixel_total : 169 time to create 1 rle with old method : 0.00020241737365722656 time for calcul the mask position with numpy : 0.008635997772216797 nb_pixel_total : 539 time to create 1 rle with old method : 0.0006201267242431641 time for calcul the mask position with numpy : 0.008642911911010742 nb_pixel_total : 4324 time to create 1 rle with old method : 0.0048978328704833984 time for calcul the mask position with numpy : 0.008723020553588867 nb_pixel_total : 191 time to create 1 rle with old method : 0.00022721290588378906 time for calcul the mask position with numpy : 0.008656501770019531 nb_pixel_total : 65 time to create 1 rle with old method : 8.916854858398438e-05 time for calcul the mask position with numpy : 0.008686304092407227 nb_pixel_total : 96 time to create 1 rle with old method : 0.00012755393981933594 time for calcul the mask position with numpy : 0.008783817291259766 nb_pixel_total : 394 time to create 1 rle with old method : 0.00044608116149902344 time for calcul the mask position with numpy : 0.008718013763427734 nb_pixel_total : 342 time to create 1 rle with old method : 0.0004220008850097656 time for calcul the mask position with numpy : 0.010394096374511719 nb_pixel_total : 15 time to create 1 rle with old method : 5.91278076171875e-05 time for calcul the mask position with numpy : 0.008766651153564453 nb_pixel_total : 533 time to create 1 rle with old method : 0.0006985664367675781 time for calcul the mask position with numpy : 0.008590459823608398 nb_pixel_total : 6375 time to create 1 rle with old method : 0.008341789245605469 time for calcul the mask position with numpy : 0.009163141250610352 nb_pixel_total : 7647 time to create 1 rle with old method : 0.008376359939575195 time for calcul the mask position with numpy : 0.008687257766723633 nb_pixel_total : 83 time to create 1 rle with old method : 0.00011396408081054688 time for calcul the mask position with numpy : 0.008594751358032227 nb_pixel_total : 471 time to create 1 rle with old method : 0.0005474090576171875 time for calcul the mask position with numpy : 0.008219718933105469 nb_pixel_total : 24 time to create 1 rle with old method : 5.555152893066406e-05 time for calcul the mask position with numpy : 0.008299589157104492 nb_pixel_total : 7389 time to create 1 rle with old method : 0.007769346237182617 time for calcul the mask position with numpy : 0.008294820785522461 nb_pixel_total : 69 time to create 1 rle with old method : 0.0001251697540283203 time for calcul the mask position with numpy : 0.008220434188842773 nb_pixel_total : 345 time to create 1 rle with old method : 0.00044727325439453125 time for calcul the mask position with numpy : 0.00837087631225586 nb_pixel_total : 1027 time to create 1 rle with old method : 0.0012013912200927734 time for calcul the mask position with numpy : 0.008308649063110352 nb_pixel_total : 271 time to create 1 rle with old method : 0.00036525726318359375 time for calcul the mask position with numpy : 0.008320331573486328 nb_pixel_total : 1439 time to create 1 rle with old method : 0.0015268325805664062 time for calcul the mask position with numpy : 0.008064746856689453 nb_pixel_total : 7 time to create 1 rle with old method : 1.3589859008789062e-05 time for calcul the mask position with numpy : 0.008347272872924805 nb_pixel_total : 5060 time to create 1 rle with old method : 0.00552058219909668 time for calcul the mask position with numpy : 0.007940530776977539 nb_pixel_total : 7887 time to create 1 rle with old method : 0.008148431777954102 time for calcul the mask position with numpy : 0.008128643035888672 nb_pixel_total : 68 time to create 1 rle with old method : 7.939338684082031e-05 time for calcul the mask position with numpy : 0.00828862190246582 nb_pixel_total : 1970 time to create 1 rle with old method : 0.002454042434692383 time for calcul the mask position with numpy : 0.008280038833618164 nb_pixel_total : 2216 time to create 1 rle with old method : 0.0025348663330078125 time for calcul the mask position with numpy : 0.008489608764648438 nb_pixel_total : 131 time to create 1 rle with old method : 0.00015878677368164062 time for calcul the mask position with numpy : 0.008304357528686523 nb_pixel_total : 229 time to create 1 rle with old method : 0.000263214111328125 time for calcul the mask position with numpy : 0.008499860763549805 nb_pixel_total : 1208 time to create 1 rle with old method : 0.0012722015380859375 time for calcul the mask position with numpy : 0.008231163024902344 nb_pixel_total : 1451 time to create 1 rle with old method : 0.0015425682067871094 time for calcul the mask position with numpy : 0.008645296096801758 nb_pixel_total : 873 time to create 1 rle with old method : 0.0009729862213134766 time for calcul the mask position with numpy : 0.00900721549987793 nb_pixel_total : 305 time to create 1 rle with old method : 0.00037479400634765625 time for calcul the mask position with numpy : 0.008800268173217773 nb_pixel_total : 1418 time to create 1 rle with old method : 0.0016474723815917969 time for calcul the mask position with numpy : 0.008634090423583984 nb_pixel_total : 6889 time to create 1 rle with old method : 0.008046388626098633 time for calcul the mask position with numpy : 0.008822202682495117 nb_pixel_total : 508 time to create 1 rle with old method : 0.0006761550903320312 time for calcul the mask position with numpy : 0.008804559707641602 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003552436828613281 time for calcul the mask position with numpy : 0.008826732635498047 nb_pixel_total : 195 time to create 1 rle with old method : 0.0002779960632324219 time for calcul the mask position with numpy : 0.008728504180908203 nb_pixel_total : 181 time to create 1 rle with old method : 0.0002391338348388672 time for calcul the mask position with numpy : 0.008893728256225586 nb_pixel_total : 192 time to create 1 rle with old method : 0.00026226043701171875 time for calcul the mask position with numpy : 0.008727312088012695 nb_pixel_total : 4166 time to create 1 rle with old method : 0.00459742546081543 time for calcul the mask position with numpy : 0.008765459060668945 nb_pixel_total : 10 time to create 1 rle with old method : 3.814697265625e-05 time for calcul the mask position with numpy : 0.008727550506591797 nb_pixel_total : 1066 time to create 1 rle with old method : 0.0013246536254882812 time for calcul the mask position with numpy : 0.008573055267333984 nb_pixel_total : 2112 time to create 1 rle with old method : 0.002711057662963867 time for calcul the mask position with numpy : 0.008216619491577148 nb_pixel_total : 68 time to create 1 rle with old method : 8.988380432128906e-05 time for calcul the mask position with numpy : 0.00818777084350586 nb_pixel_total : 2067 time to create 1 rle with old method : 0.0025610923767089844 time for calcul the mask position with numpy : 0.008520364761352539 nb_pixel_total : 89 time to create 1 rle with old method : 0.0001595020294189453 time for calcul the mask position with numpy : 0.008414983749389648 nb_pixel_total : 11914 time to create 1 rle with old method : 0.013362407684326172 time for calcul the mask position with numpy : 0.008334159851074219 nb_pixel_total : 144 time to create 1 rle with old method : 0.0001704692840576172 time for calcul the mask position with numpy : 0.008544206619262695 nb_pixel_total : 822 time to create 1 rle with old method : 0.0009081363677978516 time for calcul the mask position with numpy : 0.008563041687011719 nb_pixel_total : 959 time to create 1 rle with old method : 0.0010619163513183594 time for calcul the mask position with numpy : 0.008553743362426758 nb_pixel_total : 783 time to create 1 rle with old method : 0.0009200572967529297 time for calcul the mask position with numpy : 0.008558511734008789 nb_pixel_total : 921 time to create 1 rle with old method : 0.0010769367218017578 time for calcul the mask position with numpy : 0.00857400894165039 nb_pixel_total : 249 time to create 1 rle with old method : 0.0002963542938232422 time for calcul the mask position with numpy : 0.008490562438964844 nb_pixel_total : 30 time to create 1 rle with old method : 5.173683166503906e-05 time for calcul the mask position with numpy : 0.00858449935913086 nb_pixel_total : 259 time to create 1 rle with old method : 0.00030922889709472656 time for calcul the mask position with numpy : 0.008606195449829102 nb_pixel_total : 194 time to create 1 rle with old method : 0.00025653839111328125 time for calcul the mask position with numpy : 0.008569717407226562 nb_pixel_total : 1582 time to create 1 rle with old method : 0.0018622875213623047 time for calcul the mask position with numpy : 0.008403778076171875 nb_pixel_total : 1 time to create 1 rle with old method : 1.0251998901367188e-05 time for calcul the mask position with numpy : 0.008078575134277344 nb_pixel_total : 255 time to create 1 rle with old method : 0.00027632713317871094 time for calcul the mask position with numpy : 0.008342504501342773 nb_pixel_total : 201 time to create 1 rle with old method : 0.00023508071899414062 time for calcul the mask position with numpy : 0.008518457412719727 nb_pixel_total : 167 time to create 1 rle with old method : 0.00021004676818847656 time for calcul the mask position with numpy : 0.008481740951538086 nb_pixel_total : 516 time to create 1 rle with old method : 0.0005817413330078125 time for calcul the mask position with numpy : 0.008452415466308594 nb_pixel_total : 1997 time to create 1 rle with old method : 0.002197742462158203 time for calcul the mask position with numpy : 0.008554458618164062 nb_pixel_total : 1 time to create 1 rle with old method : 8.821487426757812e-06 time for calcul the mask position with numpy : 0.008436441421508789 nb_pixel_total : 1051 time to create 1 rle with old method : 0.001180410385131836 time for calcul the mask position with numpy : 0.00844883918762207 nb_pixel_total : 156 time to create 1 rle with old method : 0.00018739700317382812 time for calcul the mask position with numpy : 0.008505582809448242 nb_pixel_total : 110 time to create 1 rle with old method : 0.00013566017150878906 time for calcul the mask position with numpy : 0.008468389511108398 nb_pixel_total : 228 time to create 1 rle with old method : 0.00025582313537597656 time for calcul the mask position with numpy : 0.008498907089233398 nb_pixel_total : 133 time to create 1 rle with old method : 0.00016307830810546875 time for calcul the mask position with numpy : 0.008923768997192383 nb_pixel_total : 106323 time to create 1 rle with old method : 0.10976457595825195 time for calcul the mask position with numpy : 0.008346796035766602 nb_pixel_total : 186 time to create 1 rle with old method : 0.00024175643920898438 time for calcul the mask position with numpy : 0.008026599884033203 nb_pixel_total : 272 time to create 1 rle with old method : 0.00032711029052734375 time for calcul the mask position with numpy : 0.00794076919555664 nb_pixel_total : 1813 time to create 1 rle with old method : 0.0020303726196289062 time for calcul the mask position with numpy : 0.008219480514526367 nb_pixel_total : 558 time to create 1 rle with old method : 0.0006163120269775391 time for calcul the mask position with numpy : 0.008171558380126953 nb_pixel_total : 17 time to create 1 rle with old method : 5.054473876953125e-05 time for calcul the mask position with numpy : 0.008048772811889648 nb_pixel_total : 442 time to create 1 rle with old method : 0.0005123615264892578 time for calcul the mask position with numpy : 0.007987499237060547 nb_pixel_total : 43440 time to create 1 rle with old method : 0.04713082313537598 time for calcul the mask position with numpy : 0.00792551040649414 nb_pixel_total : 5019 time to create 1 rle with old method : 0.004991054534912109 time for calcul the mask position with numpy : 0.008104324340820312 nb_pixel_total : 119 time to create 1 rle with old method : 0.0001399517059326172 time for calcul the mask position with numpy : 0.008226394653320312 nb_pixel_total : 94 time to create 1 rle with old method : 0.00010538101196289062 time for calcul the mask position with numpy : 0.008250713348388672 nb_pixel_total : 256 time to create 1 rle with old method : 0.0003447532653808594 time for calcul the mask position with numpy : 0.008182525634765625 nb_pixel_total : 11 time to create 1 rle with old method : 2.2172927856445312e-05 time for calcul the mask position with numpy : 0.007980823516845703 nb_pixel_total : 1103 time to create 1 rle with old method : 0.0012254714965820312 time for calcul the mask position with numpy : 0.008149147033691406 nb_pixel_total : 105 time to create 1 rle with old method : 0.00012350082397460938 time for calcul the mask position with numpy : 0.008001089096069336 nb_pixel_total : 86 time to create 1 rle with old method : 0.00011301040649414062 time for calcul the mask position with numpy : 0.007984399795532227 nb_pixel_total : 342 time to create 1 rle with old method : 0.00038504600524902344 time for calcul the mask position with numpy : 0.007927417755126953 nb_pixel_total : 1295 time to create 1 rle with old method : 0.0013089179992675781 time for calcul the mask position with numpy : 0.008023738861083984 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003178119659423828 time for calcul the mask position with numpy : 0.007977008819580078 nb_pixel_total : 111 time to create 1 rle with old method : 0.00011968612670898438 time for calcul the mask position with numpy : 0.007828235626220703 nb_pixel_total : 32 time to create 1 rle with old method : 7.891654968261719e-05 time for calcul the mask position with numpy : 0.008017301559448242 nb_pixel_total : 43 time to create 1 rle with old method : 5.698204040527344e-05 time for calcul the mask position with numpy : 0.008057832717895508 nb_pixel_total : 370 time to create 1 rle with old method : 0.00039124488830566406 time for calcul the mask position with numpy : 0.00814199447631836 nb_pixel_total : 211 time to create 1 rle with old method : 0.0002410411834716797 time for calcul the mask position with numpy : 0.008240699768066406 nb_pixel_total : 50 time to create 1 rle with old method : 9.274482727050781e-05 time for calcul the mask position with numpy : 0.00806117057800293 nb_pixel_total : 529 time to create 1 rle with old method : 0.0006062984466552734 time for calcul the mask position with numpy : 0.008130073547363281 nb_pixel_total : 80 time to create 1 rle with old method : 0.00010466575622558594 time for calcul the mask position with numpy : 0.00819253921508789 nb_pixel_total : 572 time to create 1 rle with old method : 0.0006616115570068359 time for calcul the mask position with numpy : 0.00790858268737793 nb_pixel_total : 195 time to create 1 rle with old method : 0.00020885467529296875 time for calcul the mask position with numpy : 0.008268117904663086 nb_pixel_total : 456 time to create 1 rle with old method : 0.0005013942718505859 time for calcul the mask position with numpy : 0.008411169052124023 nb_pixel_total : 509 time to create 1 rle with old method : 0.0005819797515869141 time for calcul the mask position with numpy : 0.008250951766967773 nb_pixel_total : 673 time to create 1 rle with old method : 0.0007424354553222656 time for calcul the mask position with numpy : 0.00846552848815918 nb_pixel_total : 544 time to create 1 rle with old method : 0.0006070137023925781 time for calcul the mask position with numpy : 0.008343219757080078 nb_pixel_total : 3735 time to create 1 rle with old method : 0.003969669342041016 time for calcul the mask position with numpy : 0.008437156677246094 nb_pixel_total : 215 time to create 1 rle with old method : 0.0002422332763671875 time for calcul the mask position with numpy : 0.009543180465698242 nb_pixel_total : 460 time to create 1 rle with old method : 0.000850677490234375 time for calcul the mask position with numpy : 0.009712934494018555 nb_pixel_total : 485 time to create 1 rle with old method : 0.0008254051208496094 time for calcul the mask position with numpy : 0.009706258773803711 nb_pixel_total : 25 time to create 1 rle with old method : 7.200241088867188e-05 time for calcul the mask position with numpy : 0.009647369384765625 nb_pixel_total : 107 time to create 1 rle with old method : 0.0001957416534423828 time for calcul the mask position with numpy : 0.009639263153076172 nb_pixel_total : 1130 time to create 1 rle with old method : 0.0018799304962158203 time for calcul the mask position with numpy : 0.009714603424072266 nb_pixel_total : 219 time to create 1 rle with old method : 0.0003879070281982422 time for calcul the mask position with numpy : 0.009716272354125977 nb_pixel_total : 157 time to create 1 rle with old method : 0.00027632713317871094 time for calcul the mask position with numpy : 0.009680032730102539 nb_pixel_total : 1314 time to create 1 rle with old method : 0.002168416976928711 time for calcul the mask position with numpy : 0.008443832397460938 nb_pixel_total : 893 time to create 1 rle with old method : 0.0010540485382080078 time for calcul the mask position with numpy : 0.008308887481689453 nb_pixel_total : 1571 time to create 1 rle with old method : 0.001615285873413086 time for calcul the mask position with numpy : 0.008250951766967773 nb_pixel_total : 954 time to create 1 rle with old method : 0.0010099411010742188 time for calcul the mask position with numpy : 0.008137226104736328 nb_pixel_total : 128 time to create 1 rle with old method : 0.00014543533325195312 time for calcul the mask position with numpy : 0.008112192153930664 nb_pixel_total : 121 time to create 1 rle with old method : 0.00014543533325195312 time for calcul the mask position with numpy : 0.008142948150634766 nb_pixel_total : 242 time to create 1 rle with old method : 0.00027632713317871094 time for calcul the mask position with numpy : 0.008211612701416016 nb_pixel_total : 2 time to create 1 rle with old method : 1.2874603271484375e-05 time for calcul the mask position with numpy : 0.008119583129882812 nb_pixel_total : 273 time to create 1 rle with old method : 0.00031447410583496094 time for calcul the mask position with numpy : 0.008289098739624023 nb_pixel_total : 506 time to create 1 rle with old method : 0.0005445480346679688 time for calcul the mask position with numpy : 0.007917165756225586 nb_pixel_total : 121 time to create 1 rle with old method : 0.00014138221740722656 time for calcul the mask position with numpy : 0.007941961288452148 nb_pixel_total : 1788 time to create 1 rle with old method : 0.0018966197967529297 time for calcul the mask position with numpy : 0.008195638656616211 nb_pixel_total : 87 time to create 1 rle with old method : 0.00010466575622558594 time for calcul the mask position with numpy : 0.00816798210144043 nb_pixel_total : 55 time to create 1 rle with old method : 7.843971252441406e-05 time for calcul the mask position with numpy : 0.008319854736328125 nb_pixel_total : 1392 time to create 1 rle with old method : 0.0015671253204345703 time for calcul the mask position with numpy : 0.008598566055297852 nb_pixel_total : 859 time to create 1 rle with old method : 0.0009555816650390625 time for calcul the mask position with numpy : 0.008459329605102539 nb_pixel_total : 140 time to create 1 rle with old method : 0.00022935867309570312 time for calcul the mask position with numpy : 0.008350133895874023 nb_pixel_total : 2665 time to create 1 rle with old method : 0.00296783447265625 time for calcul the mask position with numpy : 0.008204460144042969 nb_pixel_total : 43 time to create 1 rle with old method : 8.153915405273438e-05 time for calcul the mask position with numpy : 0.008388996124267578 nb_pixel_total : 70 time to create 1 rle with old method : 8.821487426757812e-05 time for calcul the mask position with numpy : 0.008402347564697266 nb_pixel_total : 347 time to create 1 rle with old method : 0.00040340423583984375 time for calcul the mask position with numpy : 0.008115768432617188 nb_pixel_total : 260 time to create 1 rle with old method : 0.00029158592224121094 time for calcul the mask position with numpy : 0.008246660232543945 nb_pixel_total : 105 time to create 1 rle with old method : 0.00011920928955078125 time for calcul the mask position with numpy : 0.008136749267578125 nb_pixel_total : 257 time to create 1 rle with old method : 0.00033211708068847656 time for calcul the mask position with numpy : 0.008060932159423828 nb_pixel_total : 44 time to create 1 rle with old method : 6.151199340820312e-05 time for calcul the mask position with numpy : 0.008297204971313477 nb_pixel_total : 500 time to create 1 rle with old method : 0.0005762577056884766 time for calcul the mask position with numpy : 0.008214950561523438 nb_pixel_total : 2903 time to create 1 rle with old method : 0.003081798553466797 time for calcul the mask position with numpy : 0.008285999298095703 nb_pixel_total : 359 time to create 1 rle with old method : 0.0003910064697265625 time for calcul the mask position with numpy : 0.008095502853393555 nb_pixel_total : 236 time to create 1 rle with old method : 0.0002586841583251953 time for calcul the mask position with numpy : 0.008209466934204102 nb_pixel_total : 91 time to create 1 rle with old method : 0.00011277198791503906 time for calcul the mask position with numpy : 0.008101701736450195 nb_pixel_total : 22 time to create 1 rle with old method : 3.695487976074219e-05 time for calcul the mask position with numpy : 0.008166074752807617 nb_pixel_total : 280 time to create 1 rle with old method : 0.00031185150146484375 time for calcul the mask position with numpy : 0.008404254913330078 nb_pixel_total : 45 time to create 1 rle with old method : 8.916854858398438e-05 time for calcul the mask position with numpy : 0.008360862731933594 nb_pixel_total : 505 time to create 1 rle with old method : 0.0006468296051025391 time for calcul the mask position with numpy : 0.008436441421508789 nb_pixel_total : 24 time to create 1 rle with old method : 3.790855407714844e-05 time for calcul the mask position with numpy : 0.009385347366333008 nb_pixel_total : 255 time to create 1 rle with old method : 0.0002949237823486328 time for calcul the mask position with numpy : 0.008476734161376953 nb_pixel_total : 86 time to create 1 rle with old method : 0.00010204315185546875 create new chi : 2.957058906555176 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.010680913925170898 batch 1 Loaded 166 chid ids of type : 4230 Number RLEs to save : 16149 TO DO : save crop sub photo not yet done ! save time : 1.2811334133148193 nb_obj : 151 nb_hashtags : 7 time to prepare the origin masks : 2.899315118789673 time for calcul the mask position with numpy : 0.036661624908447266 nb_pixel_total : 1612215 time to create 1 rle with new method : 0.06872701644897461 time for calcul the mask position with numpy : 0.006949663162231445 nb_pixel_total : 1958 time to create 1 rle with old method : 0.002213716506958008 time for calcul the mask position with numpy : 0.006539583206176758 nb_pixel_total : 2744 time to create 1 rle with old method : 0.003048419952392578 time for calcul the mask position with numpy : 0.00659489631652832 nb_pixel_total : 88 time to create 1 rle with old method : 0.00012230873107910156 time for calcul the mask position with numpy : 0.006234169006347656 nb_pixel_total : 23 time to create 1 rle with old method : 4.863739013671875e-05 time for calcul the mask position with numpy : 0.006601810455322266 nb_pixel_total : 85 time to create 1 rle with old method : 0.000133514404296875 time for calcul the mask position with numpy : 0.006460666656494141 nb_pixel_total : 403 time to create 1 rle with old method : 0.0004646778106689453 time for calcul the mask position with numpy : 0.006321907043457031 nb_pixel_total : 660 time to create 1 rle with old method : 0.0007944107055664062 time for calcul the mask position with numpy : 0.0066204071044921875 nb_pixel_total : 1980 time to create 1 rle with old method : 0.002125978469848633 time for calcul the mask position with numpy : 0.006921291351318359 nb_pixel_total : 40720 time to create 1 rle with old method : 0.04755663871765137 time for calcul the mask position with numpy : 0.007865667343139648 nb_pixel_total : 7571 time to create 1 rle with old method : 0.009582757949829102 time for calcul the mask position with numpy : 0.007509946823120117 nb_pixel_total : 928 time to create 1 rle with old method : 0.001058340072631836 time for calcul the mask position with numpy : 0.007566928863525391 nb_pixel_total : 727 time to create 1 rle with old method : 0.0010004043579101562 time for calcul the mask position with numpy : 0.007139921188354492 nb_pixel_total : 514 time to create 1 rle with old method : 0.0005440711975097656 time for calcul the mask position with numpy : 0.006489276885986328 nb_pixel_total : 1932 time to create 1 rle with old method : 0.001992464065551758 time for calcul the mask position with numpy : 0.0063152313232421875 nb_pixel_total : 203 time to create 1 rle with old method : 0.0002446174621582031 time for calcul the mask position with numpy : 0.006593942642211914 nb_pixel_total : 80 time to create 1 rle with old method : 0.00010228157043457031 time for calcul the mask position with numpy : 0.0064525604248046875 nb_pixel_total : 872 time to create 1 rle with old method : 0.0010106563568115234 time for calcul the mask position with numpy : 0.0063991546630859375 nb_pixel_total : 432 time to create 1 rle with old method : 0.0005075931549072266 time for calcul the mask position with numpy : 0.005802631378173828 nb_pixel_total : 16 time to create 1 rle with old method : 5.2928924560546875e-05 time for calcul the mask position with numpy : 0.0060160160064697266 nb_pixel_total : 403 time to create 1 rle with old method : 0.00047135353088378906 time for calcul the mask position with numpy : 0.006661653518676758 nb_pixel_total : 2032 time to create 1 rle with old method : 0.0022385120391845703 time for calcul the mask position with numpy : 0.006387233734130859 nb_pixel_total : 7000 time to create 1 rle with old method : 0.007687807083129883 time for calcul the mask position with numpy : 0.006502866744995117 nb_pixel_total : 6844 time to create 1 rle with old method : 0.007589101791381836 time for calcul the mask position with numpy : 0.0071141719818115234 nb_pixel_total : 1022 time to create 1 rle with old method : 0.0011487007141113281 time for calcul the mask position with numpy : 0.007403135299682617 nb_pixel_total : 6 time to create 1 rle with old method : 3.3855438232421875e-05 time for calcul the mask position with numpy : 0.009116649627685547 nb_pixel_total : 517 time to create 1 rle with old method : 0.0005710124969482422 time for calcul the mask position with numpy : 0.009749174118041992 nb_pixel_total : 12 time to create 1 rle with old method : 4.1484832763671875e-05 time for calcul the mask position with numpy : 0.011084556579589844 nb_pixel_total : 153076 time to create 1 rle with new method : 0.02926921844482422 time for calcul the mask position with numpy : 0.00995945930480957 nb_pixel_total : 7668 time to create 1 rle with old method : 0.008215904235839844 time for calcul the mask position with numpy : 0.010238170623779297 nb_pixel_total : 381 time to create 1 rle with old method : 0.0004470348358154297 time for calcul the mask position with numpy : 0.009331226348876953 nb_pixel_total : 470 time to create 1 rle with old method : 0.0005803108215332031 time for calcul the mask position with numpy : 0.010248899459838867 nb_pixel_total : 2752 time to create 1 rle with old method : 0.003214120864868164 time for calcul the mask position with numpy : 0.010597467422485352 nb_pixel_total : 5721 time to create 1 rle with old method : 0.006192684173583984 time for calcul the mask position with numpy : 0.00934743881225586 nb_pixel_total : 2667 time to create 1 rle with old method : 0.002782106399536133 time for calcul the mask position with numpy : 0.009855270385742188 nb_pixel_total : 654 time to create 1 rle with old method : 0.0007631778717041016 time for calcul the mask position with numpy : 0.009069204330444336 nb_pixel_total : 594 time to create 1 rle with old method : 0.0006892681121826172 time for calcul the mask position with numpy : 0.007911205291748047 nb_pixel_total : 61 time to create 1 rle with old method : 9.298324584960938e-05 time for calcul the mask position with numpy : 0.009916305541992188 nb_pixel_total : 2454 time to create 1 rle with old method : 0.0027875900268554688 time for calcul the mask position with numpy : 0.0060329437255859375 nb_pixel_total : 144 time to create 1 rle with old method : 0.00018262863159179688 time for calcul the mask position with numpy : 0.006616353988647461 nb_pixel_total : 17625 time to create 1 rle with old method : 0.018958568572998047 time for calcul the mask position with numpy : 0.009623289108276367 nb_pixel_total : 1107 time to create 1 rle with old method : 0.0012819766998291016 time for calcul the mask position with numpy : 0.009813547134399414 nb_pixel_total : 86 time to create 1 rle with old method : 0.00012135505676269531 time for calcul the mask position with numpy : 0.010088682174682617 nb_pixel_total : 256 time to create 1 rle with old method : 0.0003688335418701172 time for calcul the mask position with numpy : 0.009253263473510742 nb_pixel_total : 1476 time to create 1 rle with old method : 0.001676321029663086 time for calcul the mask position with numpy : 0.009594440460205078 nb_pixel_total : 48 time to create 1 rle with old method : 8.106231689453125e-05 time for calcul the mask position with numpy : 0.009961605072021484 nb_pixel_total : 719 time to create 1 rle with old method : 0.0008301734924316406 time for calcul the mask position with numpy : 0.010054349899291992 nb_pixel_total : 1108 time to create 1 rle with old method : 0.0012202262878417969 time for calcul the mask position with numpy : 0.010144233703613281 nb_pixel_total : 4561 time to create 1 rle with old method : 0.005232095718383789 time for calcul the mask position with numpy : 0.00985860824584961 nb_pixel_total : 2200 time to create 1 rle with old method : 0.002500295639038086 time for calcul the mask position with numpy : 0.00982975959777832 nb_pixel_total : 212 time to create 1 rle with old method : 0.0002505779266357422 time for calcul the mask position with numpy : 0.009874820709228516 nb_pixel_total : 2004 time to create 1 rle with old method : 0.0022962093353271484 time for calcul the mask position with numpy : 0.00890493392944336 nb_pixel_total : 46 time to create 1 rle with old method : 8.058547973632812e-05 time for calcul the mask position with numpy : 0.011481523513793945 nb_pixel_total : 130 time to create 1 rle with old method : 0.00016617774963378906 time for calcul the mask position with numpy : 0.013770580291748047 nb_pixel_total : 276 time to create 1 rle with old method : 0.0005273818969726562 time for calcul the mask position with numpy : 0.012485742568969727 nb_pixel_total : 13 time to create 1 rle with old method : 4.363059997558594e-05 time for calcul the mask position with numpy : 0.007557868957519531 nb_pixel_total : 306 time to create 1 rle with old method : 0.0003528594970703125 time for calcul the mask position with numpy : 0.007353305816650391 nb_pixel_total : 467 time to create 1 rle with old method : 0.0006780624389648438 time for calcul the mask position with numpy : 0.007445573806762695 nb_pixel_total : 131 time to create 1 rle with old method : 0.0002124309539794922 time for calcul the mask position with numpy : 0.007460117340087891 nb_pixel_total : 779 time to create 1 rle with old method : 0.001056671142578125 time for calcul the mask position with numpy : 0.007865190505981445 nb_pixel_total : 20214 time to create 1 rle with old method : 0.026115894317626953 time for calcul the mask position with numpy : 0.007282733917236328 nb_pixel_total : 373 time to create 1 rle with old method : 0.0005097389221191406 time for calcul the mask position with numpy : 0.00646209716796875 nb_pixel_total : 1281 time to create 1 rle with old method : 0.0014545917510986328 time for calcul the mask position with numpy : 0.006087303161621094 nb_pixel_total : 661 time to create 1 rle with old method : 0.0007617473602294922 time for calcul the mask position with numpy : 0.00621342658996582 nb_pixel_total : 223 time to create 1 rle with old method : 0.0002589225769042969 time for calcul the mask position with numpy : 0.0061380863189697266 nb_pixel_total : 275 time to create 1 rle with old method : 0.0003399848937988281 time for calcul the mask position with numpy : 0.006018400192260742 nb_pixel_total : 156 time to create 1 rle with old method : 0.0002040863037109375 time for calcul the mask position with numpy : 0.0060901641845703125 nb_pixel_total : 1712 time to create 1 rle with old method : 0.0018668174743652344 time for calcul the mask position with numpy : 0.006234884262084961 nb_pixel_total : 2243 time to create 1 rle with old method : 0.002481698989868164 time for calcul the mask position with numpy : 0.006117343902587891 nb_pixel_total : 102 time to create 1 rle with old method : 0.00013208389282226562 time for calcul the mask position with numpy : 0.006155729293823242 nb_pixel_total : 188 time to create 1 rle with old method : 0.00022602081298828125 time for calcul the mask position with numpy : 0.0061681270599365234 nb_pixel_total : 197 time to create 1 rle with old method : 0.00024890899658203125 time for calcul the mask position with numpy : 0.006018638610839844 nb_pixel_total : 607 time to create 1 rle with old method : 0.0007996559143066406 time for calcul the mask position with numpy : 0.01009988784790039 nb_pixel_total : 1960 time to create 1 rle with old method : 0.0021371841430664062 time for calcul the mask position with numpy : 0.006502866744995117 nb_pixel_total : 1057 time to create 1 rle with old method : 0.0010881423950195312 time for calcul the mask position with numpy : 0.0061604976654052734 nb_pixel_total : 171 time to create 1 rle with old method : 0.00024056434631347656 time for calcul the mask position with numpy : 0.006033658981323242 nb_pixel_total : 394 time to create 1 rle with old method : 0.00044417381286621094 time for calcul the mask position with numpy : 0.005987882614135742 nb_pixel_total : 95 time to create 1 rle with old method : 0.00011491775512695312 time for calcul the mask position with numpy : 0.006162881851196289 nb_pixel_total : 280 time to create 1 rle with old method : 0.00030994415283203125 time for calcul the mask position with numpy : 0.006747007369995117 nb_pixel_total : 104932 time to create 1 rle with old method : 0.11019706726074219 time for calcul the mask position with numpy : 0.006197452545166016 nb_pixel_total : 283 time to create 1 rle with old method : 0.0003292560577392578 time for calcul the mask position with numpy : 0.006174802780151367 nb_pixel_total : 8 time to create 1 rle with old method : 3.910064697265625e-05 time for calcul the mask position with numpy : 0.006107330322265625 nb_pixel_total : 945 time to create 1 rle with old method : 0.0010685920715332031 time for calcul the mask position with numpy : 0.006235599517822266 nb_pixel_total : 75 time to create 1 rle with old method : 0.00010895729064941406 time for calcul the mask position with numpy : 0.005980491638183594 nb_pixel_total : 1375 time to create 1 rle with old method : 0.0014538764953613281 time for calcul the mask position with numpy : 0.0061070919036865234 nb_pixel_total : 17 time to create 1 rle with old method : 4.8160552978515625e-05 time for calcul the mask position with numpy : 0.006209373474121094 nb_pixel_total : 114 time to create 1 rle with old method : 0.0001709461212158203 time for calcul the mask position with numpy : 0.006093740463256836 nb_pixel_total : 5904 time to create 1 rle with old method : 0.006346225738525391 time for calcul the mask position with numpy : 0.006022453308105469 nb_pixel_total : 424 time to create 1 rle with old method : 0.0004992485046386719 time for calcul the mask position with numpy : 0.005974292755126953 nb_pixel_total : 40 time to create 1 rle with old method : 8.988380432128906e-05 time for calcul the mask position with numpy : 0.006078481674194336 nb_pixel_total : 1302 time to create 1 rle with old method : 0.0014481544494628906 time for calcul the mask position with numpy : 0.006294727325439453 nb_pixel_total : 136 time to create 1 rle with old method : 0.00017952919006347656 time for calcul the mask position with numpy : 0.006436586380004883 nb_pixel_total : 97 time to create 1 rle with old method : 0.0001933574676513672 time for calcul the mask position with numpy : 0.006175041198730469 nb_pixel_total : 499 time to create 1 rle with old method : 0.0007319450378417969 time for calcul the mask position with numpy : 0.006246089935302734 nb_pixel_total : 1296 time to create 1 rle with old method : 0.001459360122680664 time for calcul the mask position with numpy : 0.0069162845611572266 nb_pixel_total : 232 time to create 1 rle with old method : 0.00028967857360839844 time for calcul the mask position with numpy : 0.0066375732421875 nb_pixel_total : 278 time to create 1 rle with old method : 0.0003457069396972656 time for calcul the mask position with numpy : 0.006826877593994141 nb_pixel_total : 40 time to create 1 rle with old method : 7.390975952148438e-05 time for calcul the mask position with numpy : 0.00697779655456543 nb_pixel_total : 351 time to create 1 rle with old method : 0.0005133152008056641 time for calcul the mask position with numpy : 0.006924152374267578 nb_pixel_total : 671 time to create 1 rle with old method : 0.0007894039154052734 time for calcul the mask position with numpy : 0.007498264312744141 nb_pixel_total : 120 time to create 1 rle with old method : 0.0001556873321533203 time for calcul the mask position with numpy : 0.007521152496337891 nb_pixel_total : 42 time to create 1 rle with old method : 7.033348083496094e-05 time for calcul the mask position with numpy : 0.007389068603515625 nb_pixel_total : 77 time to create 1 rle with old method : 0.00010967254638671875 time for calcul the mask position with numpy : 0.0070590972900390625 nb_pixel_total : 46 time to create 1 rle with old method : 8.511543273925781e-05 time for calcul the mask position with numpy : 0.00728154182434082 nb_pixel_total : 157 time to create 1 rle with old method : 0.00020956993103027344 time for calcul the mask position with numpy : 0.007372856140136719 nb_pixel_total : 527 time to create 1 rle with old method : 0.0006048679351806641 time for calcul the mask position with numpy : 0.0076885223388671875 nb_pixel_total : 182 time to create 1 rle with old method : 0.00023365020751953125 time for calcul the mask position with numpy : 0.007946014404296875 nb_pixel_total : 455 time to create 1 rle with old method : 0.0006589889526367188 time for calcul the mask position with numpy : 0.007504940032958984 nb_pixel_total : 301 time to create 1 rle with old method : 0.0004410743713378906 time for calcul the mask position with numpy : 0.007515907287597656 nb_pixel_total : 384 time to create 1 rle with old method : 0.0005161762237548828 time for calcul the mask position with numpy : 0.007772207260131836 nb_pixel_total : 638 time to create 1 rle with old method : 0.0008261203765869141 time for calcul the mask position with numpy : 0.007478475570678711 nb_pixel_total : 204 time to create 1 rle with old method : 0.0003211498260498047 time for calcul the mask position with numpy : 0.008090972900390625 nb_pixel_total : 417 time to create 1 rle with old method : 0.0006275177001953125 time for calcul the mask position with numpy : 0.007289886474609375 nb_pixel_total : 96 time to create 1 rle with old method : 0.0001227855682373047 time for calcul the mask position with numpy : 0.006691694259643555 nb_pixel_total : 380 time to create 1 rle with old method : 0.0004055500030517578 time for calcul the mask position with numpy : 0.00659489631652832 nb_pixel_total : 226 time to create 1 rle with old method : 0.0002892017364501953 time for calcul the mask position with numpy : 0.0064885616302490234 nb_pixel_total : 690 time to create 1 rle with old method : 0.0008502006530761719 time for calcul the mask position with numpy : 0.0064678192138671875 nb_pixel_total : 106 time to create 1 rle with old method : 0.00013780593872070312 time for calcul the mask position with numpy : 0.006280422210693359 nb_pixel_total : 1366 time to create 1 rle with old method : 0.0015075206756591797 time for calcul the mask position with numpy : 0.0062906742095947266 nb_pixel_total : 170 time to create 1 rle with old method : 0.0002498626708984375 time for calcul the mask position with numpy : 0.006684064865112305 nb_pixel_total : 1400 time to create 1 rle with old method : 0.0015583038330078125 time for calcul the mask position with numpy : 0.006194591522216797 nb_pixel_total : 402 time to create 1 rle with old method : 0.0005183219909667969 time for calcul the mask position with numpy : 0.006177663803100586 nb_pixel_total : 85 time to create 1 rle with old method : 0.00011754035949707031 time for calcul the mask position with numpy : 0.006528139114379883 nb_pixel_total : 63 time to create 1 rle with old method : 9.822845458984375e-05 time for calcul the mask position with numpy : 0.006484508514404297 nb_pixel_total : 1544 time to create 1 rle with old method : 0.0017189979553222656 time for calcul the mask position with numpy : 0.006257057189941406 nb_pixel_total : 155 time to create 1 rle with old method : 0.00019478797912597656 time for calcul the mask position with numpy : 0.006331682205200195 nb_pixel_total : 690 time to create 1 rle with old method : 0.0007781982421875 time for calcul the mask position with numpy : 0.006120204925537109 nb_pixel_total : 227 time to create 1 rle with old method : 0.0002582073211669922 time for calcul the mask position with numpy : 0.006064891815185547 nb_pixel_total : 292 time to create 1 rle with old method : 0.0003421306610107422 time for calcul the mask position with numpy : 0.006268739700317383 nb_pixel_total : 310 time to create 1 rle with old method : 0.0003628730773925781 time for calcul the mask position with numpy : 0.006096839904785156 nb_pixel_total : 118 time to create 1 rle with old method : 0.00016117095947265625 time for calcul the mask position with numpy : 0.008470773696899414 nb_pixel_total : 186 time to create 1 rle with old method : 0.00040912628173828125 time for calcul the mask position with numpy : 0.010109186172485352 nb_pixel_total : 52 time to create 1 rle with old method : 0.00012350082397460938 time for calcul the mask position with numpy : 0.006442070007324219 nb_pixel_total : 94 time to create 1 rle with old method : 0.00013136863708496094 time for calcul the mask position with numpy : 0.006133079528808594 nb_pixel_total : 1512 time to create 1 rle with old method : 0.0017328262329101562 time for calcul the mask position with numpy : 0.006256103515625 nb_pixel_total : 458 time to create 1 rle with old method : 0.0006046295166015625 time for calcul the mask position with numpy : 0.006632089614868164 nb_pixel_total : 127 time to create 1 rle with old method : 0.00019860267639160156 time for calcul the mask position with numpy : 0.0060214996337890625 nb_pixel_total : 92 time to create 1 rle with old method : 0.00013208389282226562 time for calcul the mask position with numpy : 0.006211519241333008 nb_pixel_total : 361 time to create 1 rle with old method : 0.00042629241943359375 time for calcul the mask position with numpy : 0.006086587905883789 nb_pixel_total : 540 time to create 1 rle with old method : 0.0006458759307861328 time for calcul the mask position with numpy : 0.00592350959777832 nb_pixel_total : 495 time to create 1 rle with old method : 0.000579833984375 time for calcul the mask position with numpy : 0.006125688552856445 nb_pixel_total : 225 time to create 1 rle with old method : 0.0002665519714355469 time for calcul the mask position with numpy : 0.005939483642578125 nb_pixel_total : 63 time to create 1 rle with old method : 0.00014448165893554688 time for calcul the mask position with numpy : 0.0059490203857421875 nb_pixel_total : 2439 time to create 1 rle with old method : 0.002626180648803711 time for calcul the mask position with numpy : 0.0062329769134521484 nb_pixel_total : 355 time to create 1 rle with old method : 0.0004100799560546875 time for calcul the mask position with numpy : 0.0060770511627197266 nb_pixel_total : 221 time to create 1 rle with old method : 0.0002651214599609375 time for calcul the mask position with numpy : 0.005970954895019531 nb_pixel_total : 50 time to create 1 rle with old method : 7.62939453125e-05 time for calcul the mask position with numpy : 0.006295204162597656 nb_pixel_total : 506 time to create 1 rle with old method : 0.0005621910095214844 time for calcul the mask position with numpy : 0.006067752838134766 nb_pixel_total : 125 time to create 1 rle with old method : 0.00016832351684570312 time for calcul the mask position with numpy : 0.005893230438232422 nb_pixel_total : 177 time to create 1 rle with old method : 0.00022482872009277344 time for calcul the mask position with numpy : 0.0062601566314697266 nb_pixel_total : 182 time to create 1 rle with old method : 0.00023674964904785156 time for calcul the mask position with numpy : 0.005945920944213867 nb_pixel_total : 83 time to create 1 rle with old method : 0.00011110305786132812 create new chi : 1.5834367275238037 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0018072128295898438 batch 1 Loaded 152 chid ids of type : 4230 Number RLEs to save : 14498 TO DO : save crop sub photo not yet done ! save time : 1.1391799449920654 map_output_result : {1333477138: (0.0, 'Should be the crop_list due to order', 0.0), 1333476998: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1333477138, 1333476998] Looping around the photos to save general results len do output : 2 /1333477138.Didn't retrieve data . /1333476998.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535626') ('4234', '20124876', '1333477138', None, None, None, None, None, '2535626') ('4234', None, None, None, None, None, None, None, '2535626') ('4234', '20124876', '1333476998', None, None, None, None, None, '2535626') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.0984947681427002 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.476742267608643 time spend to save output : 0.09884953498840332 total time spend for step 4 : 11.575591802597046 step5:crop_condition Sat Feb 1 06:21:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 2 ! batch 1 Loaded 318 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 131 About to insert : list_path_to_insert length 131 new photo from crops ! About to upload 131 photos upload in portfolio : 4869462 init cache_photo without model_param we have 131 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738387272_3490722 we have uploaded 131 photos in the portfolio 4869462 time of upload the photos Elapsed time : 40.84619092941284 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 37 About to insert : list_path_to_insert length 37 new photo from crops ! About to upload 37 photos upload in portfolio : 4869462 init cache_photo without model_param we have 37 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738387314_3490722 we have uploaded 37 photos in the portfolio 4869462 time of upload the photos Elapsed time : 9.334183931350708 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 4869462 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738387324_3490722 we have uploaded 24 photos in the portfolio 4869462 time of upload the photos Elapsed time : 5.4513490200042725 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 4869462 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738387330_3490722 we have uploaded 29 photos in the portfolio 4869462 time of upload the photos Elapsed time : 7.426470518112183 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1333477138, 1333476998] Looping around the photos to save general results len do output : 221 /1333620167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333620416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535626') ('4234', '20124876', '1333477138', None, None, None, None, None, '2535626') ('4234', None, None, None, None, None, None, None, '2535626') ('4234', '20124876', '1333476998', None, None, None, None, None, '2535626') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 665 time used for this insertion : 0.06359505653381348 save_final save missing photos in datou_result : time spend for datou_step_exec : 67.61565279960632 time spend to save output : 0.07176852226257324 total time spend for step 5 : 67.6874213218689 step6:thcl Sat Feb 1 06:22:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.00743556022644043 time to convert the images to numpy array : 0.03427267074584961 time to import caffe and check if the image exist : 0.009619712829589844 time to convert the images to numpy array : 0.0507359504699707 time to import caffe and check if the image exist : 0.01053309440612793 time to convert the images to numpy array : 0.06097269058227539 time to import caffe and check if the image exist : 0.018970251083374023 time to convert the images to numpy array : 0.06470489501953125 time to import caffe and check if the image exist : 0.02339911460876465 time to convert the images to numpy array : 0.06318545341491699 time to import caffe and check if the image exist : 0.021018266677856445 time to convert the images to numpy array : 0.06566286087036133 time to import caffe and check if the image exist : 0.01939868927001953 time to convert the images to numpy array : 0.07138657569885254 time to import caffe and check if the image exist : 0.022665023803710938 time to convert the images to numpy array : 0.06893444061279297 time to import caffe and check if the image exist : 0.03398323059082031 time to convert the images to numpy array : 0.05795860290527344 time to import caffe and check if the image exist : 0.022045373916625977 time to convert the images to numpy array : 0.07385897636413574 total time to convert the images to numpy array : 0.45461368560791016 list photo_ids error: [] list photo_ids correct : [1333620403, 1333620404, 1333620405, 1333620406, 1333620407, 1333620408, 1333620409, 1333620410, 1333620411, 1333620412, 1333620413, 1333620414, 1333620415, 1333620416, 1333620167, 1333620168, 1333620169, 1333620170, 1333620171, 1333620172, 1333620173, 1333620174, 1333620175, 1333620176, 1333620177, 1333620178, 1333620179, 1333620180, 1333620181, 1333620182, 1333620183, 1333620184, 1333620185, 1333620186, 1333620187, 1333620188, 1333620192, 1333620246, 1333620247, 1333620248, 1333620249, 1333620250, 1333620251, 1333620252, 1333620253, 1333620254, 1333620255, 1333620256, 1333620257, 1333620258, 1333620259, 1333620260, 1333620263, 1333620264, 1333620265, 1333620266, 1333620267, 1333620268, 1333620269, 1333620270, 1333620379, 1333620380, 1333620381, 1333620382, 1333620383, 1333620384, 1333620385, 1333620386, 1333620387, 1333620388, 1333620389, 1333620390, 1333620391, 1333620392, 1333620393, 1333620395, 1333620396, 1333620397, 1333620398, 1333620399, 1333620400, 1333620401, 1333620402, 1333620194, 1333620195, 1333620196, 1333620197, 1333620198, 1333620199, 1333620200, 1333620201, 1333620202, 1333620203, 1333620204, 1333620205, 1333620206, 1333620207, 1333620208, 1333620209, 1333620210, 1333620211, 1333620212, 1333620213, 1333620214, 1333620216, 1333620217, 1333620272, 1333620273, 1333620274, 1333620275, 1333620276, 1333620277, 1333620278, 1333620279, 1333620280, 1333620281, 1333620282, 1333620283, 1333620284, 1333620285, 1333620286, 1333620287, 1333620288, 1333620289, 1333620290, 1333620291, 1333620292, 1333620293, 1333620294, 1333620219, 1333620220, 1333620221, 1333620222, 1333620223, 1333620225, 1333620228, 1333620229, 1333620230, 1333620231, 1333620232, 1333620234, 1333620235, 1333620236, 1333620237, 1333620238, 1333620239, 1333620240, 1333620241, 1333620242, 1333620243, 1333620244, 1333620245, 1333620295, 1333620296, 1333620297, 1333620298, 1333620299, 1333620300, 1333620301, 1333620302, 1333620303, 1333620304, 1333620305, 1333620306, 1333620308, 1333620309, 1333620310, 1333620311, 1333620316, 1333620317, 1333620318, 1333620319, 1333620320, 1333620321, 1333620322, 1333620323, 1333620326, 1333620328, 1333620329, 1333620330, 1333620331, 1333620333, 1333620334, 1333620335, 1333620336, 1333620337, 1333620338, 1333620339, 1333620340, 1333620341, 1333620342, 1333620343, 1333620344, 1333620345, 1333620346, 1333620347, 1333620348, 1333620349, 1333620350, 1333620351, 1333620352, 1333620354, 1333620355, 1333620356, 1333620357, 1333620363, 1333620364, 1333620365, 1333620366, 1333620367, 1333620368, 1333620369, 1333620370, 1333620371, 1333620372, 1333620373, 1333620374, 1333620375, 1333620376, 1333620377, 1333620378] number of photos to traite : 221 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3378 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3159 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.1188163757324219 time used to do the prediction : 0.99945068359375 save descriptor for thcl : 3237 time to traite the descriptors : 1.5873007774353027 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1333620403 To insert : 1333620404 To insert : 1333620405 To insert : 1333620406 To insert : 1333620407 To insert : 1333620408 To insert : 1333620409 To insert : 1333620410 To insert : 1333620411 To insert : 1333620412 To insert : 1333620413 To insert : 1333620414 To insert : 1333620415 To insert : 1333620416 To insert : 1333620167 To insert : 1333620168 To insert : 1333620169 To insert : 1333620170 To insert : 1333620171 To insert : 1333620172 To insert : 1333620173 To insert : 1333620174 To insert : 1333620175 To insert : 1333620176 To insert : 1333620177 To insert : 1333620178 To insert : 1333620179 To insert : 1333620180 To insert : 1333620181 To insert : 1333620182 To insert : 1333620183 To insert : 1333620184 To insert : 1333620185 To insert : 1333620186 To insert : 1333620187 To insert : 1333620188 To insert : 1333620192 To insert : 1333620246 To insert : 1333620247 To insert : 1333620248 To insert : 1333620249 To insert : 1333620250 To insert : 1333620251 To insert : 1333620252 To insert : 1333620253 To insert : 1333620254 To insert : 1333620255 To insert : 1333620256 To insert : 1333620257 To insert : 1333620258 To insert : 1333620259 To insert : 1333620260 To insert : 1333620263 To insert : 1333620264 To insert : 1333620265 To insert : 1333620266 To insert : 1333620267 To insert : 1333620268 To insert : 1333620269 To insert : 1333620270 To insert : 1333620379 To insert : 1333620380 To insert : 1333620381 To insert : 1333620382 To insert : 1333620383 To insert : 1333620384 To insert : 1333620385 To insert : 1333620386 To insert : 1333620387 To insert : 1333620388 To insert : 1333620389 To insert : 1333620390 To insert : 1333620391 To insert : 1333620392 To insert : 1333620393 To insert : 1333620395 To insert : 1333620396 To insert : 1333620397 To insert : 1333620398 To insert : 1333620399 To insert : 1333620400 To insert : 1333620401 To insert : 1333620402 To insert : 1333620194 To insert : 1333620195 To insert : 1333620196 To insert : 1333620197 To insert : 1333620198 To insert : 1333620199 To insert : 1333620200 To insert : 1333620201 To insert : 1333620202 To insert : 1333620203 To insert : 1333620204 To insert : 1333620205 To insert : 1333620206 To insert : 1333620207 To insert : 1333620208 To insert : 1333620209 To insert : 1333620210 To insert : 1333620211 To insert : 1333620212 To insert : 1333620213 To insert : 1333620214 To insert : 1333620216 To insert : 1333620217 To insert : 1333620272 To insert : 1333620273 To insert : 1333620274 To insert : 1333620275 To insert : 1333620276 To insert : 1333620277 To insert : 1333620278 To insert : 1333620279 To insert : 1333620280 To insert : 1333620281 To insert : 1333620282 To insert : 1333620283 To insert : 1333620284 To insert : 1333620285 To insert : 1333620286 To insert : 1333620287 To insert : 1333620288 To insert : 1333620289 To insert : 1333620290 To insert : 1333620291 To insert : 1333620292 To insert : 1333620293 To insert : 1333620294 To insert : 1333620219 To insert : 1333620220 To insert : 1333620221 To insert : 1333620222 To insert : 1333620223 To insert : 1333620225 To insert : 1333620228 To insert : 1333620229 To insert : 1333620230 To insert : 1333620231 To insert : 1333620232 To insert : 1333620234 To insert : 1333620235 To insert : 1333620236 To insert : 1333620237 To insert : 1333620238 To insert : 1333620239 To insert : 1333620240 To insert : 1333620241 To insert : 1333620242 To insert : 1333620243 To insert : 1333620244 To insert : 1333620245 To insert : 1333620295 To insert : 1333620296 To insert : 1333620297 To insert : 1333620298 To insert : 1333620299 To insert : 1333620300 To insert : 1333620301 To insert : 1333620302 To insert : 1333620303 To insert : 1333620304 To insert : 1333620305 To insert : 1333620306 To insert : 1333620308 To insert : 1333620309 To insert : 1333620310 To insert : 1333620311 To insert : 1333620316 To insert : 1333620317 To insert : 1333620318 To insert : 1333620319 To insert : 1333620320 To insert : 1333620321 To insert : 1333620322 To insert : 1333620323 To insert : 1333620326 To insert : 1333620328 To insert : 1333620329 To insert : 1333620330 To insert : 1333620331 To insert : 1333620333 To insert : 1333620334 To insert : 1333620335 To insert : 1333620336 To insert : 1333620337 To insert : 1333620338 To insert : 1333620339 To insert : 1333620340 To insert : 1333620341 To insert : 1333620342 To insert : 1333620343 To insert : 1333620344 To insert : 1333620345 To insert : 1333620346 To insert : 1333620347 To insert : 1333620348 To insert : 1333620349 To insert : 1333620350 To insert : 1333620351 To insert : 1333620352 To insert : 1333620354 To insert : 1333620355 To insert : 1333620356 To insert : 1333620357 To insert : 1333620363 To insert : 1333620364 To insert : 1333620365 To insert : 1333620366 To insert : 1333620367 To insert : 1333620368 To insert : 1333620369 To insert : 1333620370 To insert : 1333620371 To insert : 1333620372 To insert : 1333620373 To insert : 1333620374 To insert : 1333620375 To insert : 1333620376 To insert : 1333620377 To insert : 1333620378 time to insert the descriptors : 39.20919418334961 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 346 time used for this insertion : 0.03110957145690918 save missing photos in datou_result : time spend for datou_step_exec : 47.51899480819702 time spend to save output : 0.08393001556396484 total time spend for step 6 : 47.602924823760986 step7:ventilate_hashtags_in_portfolio Sat Feb 1 06:23:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20124876 get user id for portfolio 20124876 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20124876 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PET_fonce','pehd','refus','Film_plastique','Carton','papier','PET_clair','Tetrapak','environnement','PEHD','carton','autre','pet_clair','mal_croppe','Papier','metal','pet_fonce','flou')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20124876 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PET_fonce','pehd','refus','Film_plastique','Carton','papier','PET_clair','Tetrapak','environnement','PEHD','carton','autre','pet_clair','mal_croppe','Papier','metal','pet_fonce','flou')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20124876 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PET_fonce','pehd','refus','Film_plastique','Carton','papier','PET_clair','Tetrapak','environnement','PEHD','carton','autre','pet_clair','mal_croppe','Papier','metal','pet_fonce','flou')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20124876 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PET_fonce','pehd','refus','Film_plastique','Carton','papier','PET_clair','Tetrapak','environnement','PEHD','carton','autre','pet_clair','mal_croppe','Papier','metal','pet_fonce','flou')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20136562,20136555,20136548,20136549,20136556,20136560,20136558,20136553,20136554,20136557,20136559,20136561,20136563?tags=pet_fonce,pehd,refus,film_plastique,carton,papier,pet_clair,tetrapak,environnement,autre,mal_croppe,metal,flou&datou_id_consolidate=4235&port_consolidate=20124876 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1333477138, 1333476998] Looping around the photos to save general results len do output : 1 /20124876. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535626') ('4234', '20124876', '1333477138', None, None, None, None, None, '2535626') ('4234', None, None, None, None, None, None, None, '2535626') ('4234', '20124876', '1333476998', None, None, None, None, None, '2535626') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.016159772872924805 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.108788251876831 time spend to save output : 0.016394376754760742 total time spend for step 7 : 5.125182628631592 step8:final Sat Feb 1 06:23:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1333477138: ('0.26730710181938827',), 1333476998: ('0.26730710181938827',)} new output for save of step final : {1333477138: ('0.26730710181938827',), 1333476998: ('0.26730710181938827',)} [1333477138, 1333476998] Looping around the photos to save general results len do output : 2 /1333477138.Didn't retrieve data . /1333476998.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535626') ('4234', '20124876', '1333477138', None, None, None, None, None, '2535626') ('4234', None, None, None, None, None, None, None, '2535626') ('4234', '20124876', '1333476998', None, None, None, None, None, '2535626') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013262271881103516 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1097402572631836 time spend to save output : 0.013512849807739258 total time spend for step 8 : 0.12325310707092285 step9:velours_tree Sat Feb 1 06:23:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20136562,20136555,20136548,20136549,20136556,20136560,20136558,20136553,20136554,20136557,20136559,20136561,20136563 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20136562 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20136555 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20136548 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20136549 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20136556 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20136560 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20136558 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20136553 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20136554 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20136557 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20136559 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20136561 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20136563 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 221 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [4 2 5 1 1 3 1 1 5 2 2 3 2 2 0 2 4 3 2 0 2 2 2 2 0 3 2 0 4 2 4 2 0 1 3 2 3 4 3 3 3 4 2 2 0 3 2 2 3 0 3 3 1 3 3 3 2 5 0 3 3 2 3 5 1 1 1 1 2 2 3 2 2 0 2 3 3 2 2 1 2 2 2 2 2 2 0 2 2 3 4 0 2 2 4 4 2 0 3 1 2 3 1 2 3 3 2 3 2 4 4 3 4 1 3 2 3 1 3 0 3 1 2 3 5 0 3 0 0 3 2 2 4 1 3 3 3 3 4 3 5 3 1 3 1 3 0 0 2 0 0 5 3 3 2 1 3 3 3 5 3 4 1 0 0 0 0 0 0 2 0 2 5 0 0 0 4 5 4 3 4 4 2 0 2 0 0 0 4 0 4 4 0 4 2 1 3 3 3 3 2 3 1 3 3 4 4 4 3 2 2 3 0 4 2 1 2 4 1 3 3] Elapsed time: 0.035132408142089844 graph_id used : 74962 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20136562,20136555,20136548,20136549,20136556,20136560,20136558,20136553,20136554,20136557,20136559,20136561,20136563?tags=pet_fonce,pehd,refus,film_plastique,carton,papier,pet_clair,tetrapak,environnement,autre,mal_croppe,metal,flou&datou_id_consolidate=4235&port_consolidate=20124876&tree_id=74962 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1333477138, 1333476998] Looping around the photos to save general results len do output : 1 /20124876Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535626') ('4234', '20124876', '1333477138', None, None, None, None, None, '2535626') ('4234', None, None, None, None, None, None, None, '2535626') ('4234', '20124876', '1333476998', None, None, None, None, None, '2535626') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.014770269393920898 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.382671356201172 time spend to save output : 0.015012979507446289 total time spend for step 9 : 14.397684335708618 step10:send_mail_cod Sat Feb 1 06:23:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20124876_01-02-2025_06_23_25.pdf 20136544 imagette201365441738387405 20136537 imagette201365371738387405 20136530 imagette201365301738387405 20136531 imagette201365311738387405 20136538 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201365381738387405 20136542 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201365421738387406 20136540 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201365401738387407 20136535 imagette201365351738387408 20136539 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201365391738387408 20136541 imagette201365411738387409 20136543 imagette201365431738387409 20136545 imagette201365451738387409 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20124876 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20136562,20136555,20136548,20136549,20136556,20136560,20136558,20136553,20136554,20136557,20136559,20136561,20136563?tags=pet_fonce,pehd,refus,film_plastique,carton,papier,pet_clair,tetrapak,environnement,autre,mal_croppe,metal,flou&datou_id_consolidate=4235&port_consolidate=20124876&tree_id=74962 your option no_mail is active, we will not send the real mail to your client args[1333477138] : ((1333477138, -8.217034253533944, 492609224), (1333477138, -0.30313876129459066, 496442774), '0.26730710181938827') We are sending mail with results at cod@fotonower.com args[1333476998] : ((1333476998, -8.201524784966612, 492609224), (1333476998, -0.2449913094419921, 496442774), '0.26730710181938827') We are sending mail with results at cod@fotonower.com refus_total : 0.26730710181938827 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20124876 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20124876_01-02-2025_06_23_25.pdf results_Qualipapia_P20124876_01-02-2025_06_23_25.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20124876_01-02-2025_06_23_25.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20124876','results_Qualipapia_P20124876_01-02-2025_06_23_25.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20124876_01-02-2025_06_23_25.pdf','pdf','','0.17','0.26730710181938827') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1333477138, 1333476998] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535626') ('4234', '20124876', '1333477138', None, None, None, None, None, '2535626') ('4234', None, None, None, None, None, None, None, '2535626') ('4234', '20124876', '1333476998', None, None, None, None, None, '2535626') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.012748003005981445 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.883627891540527 time spend to save output : 0.012971162796020508 total time spend for step 10 : 4.896599054336548 step11:split_time_score Sat Feb 1 06:23:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 2),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 31012025 20124876 Nombre de photos uploadées : 2 / 23040 (0%) 31012025 20124876 Nombre de photos taguées (types de déchets): 2 / 2 (100%) 31012025 20124876 Nombre de photos taguées (volume) : 0 / 2 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.9604644775390625e-06 ?? elapsed_time : fill_and_build_computed_from_old_data 0.00025343894958496094 elapsed_time : insert_dashboard_record_day_entry 0.023988723754882812 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.16675929361879244 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20104701_31-01-2025_08_52_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20104701 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20104701 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106630 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106631 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106632 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106633 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106634 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106635 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106636 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106637 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106638 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106639 order by id desc limit 1 Qualite : 0.19140746727627336 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20106640_31-01-2025_09_48_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106640 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20106640 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106641 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108219 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108222 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108224 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108226 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108227 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108229 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108231 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108233 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108237 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108239 order by id desc limit 1 Qualite : 0.2536259478254959 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20115128_31-01-2025_18_26_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115128 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20115128 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110587 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110608 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110610 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110613 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110616 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110618 order by id desc limit 1 Qualite : 0.25117894084688863 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20110621_31-01-2025_11_49_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110621 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110621 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110623 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110625 order by id desc limit 1 Qualite : 0.2879457038717212 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20110626_31-01-2025_11_33_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110626 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110626 AND mptpi.`type`=4230 To do Qualite : 0.29441342724686403 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20110628_31-01-2025_11_19_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110628 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110628 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114557 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114558 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114559 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114560 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114561 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114562 order by id desc limit 1 Qualite : 0.23808314138688313 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20114563_31-01-2025_17_48_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114563 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20114563 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114564 order by id desc limit 1 Qualite : 0.2576423828494527 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20114565_31-01-2025_12_57_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114565 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20114565 AND mptpi.`type`=4230 To do Qualite : 0.19770651428243047 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20114566_31-01-2025_16_47_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114566 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20114566 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113516 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113517 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113519 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113521 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113523 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113525 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113527 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113529 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113530 order by id desc limit 1 Qualite : 0.2760275473614038 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20113531_31-01-2025_12_33_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113531 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20113531 AND mptpi.`type`=4230 To do Qualite : 0.20026238582895103 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20113532_31-01-2025_12_18_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113532 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20113532 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119099 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119100 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119101 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119102 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119103 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119104 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119105 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119106 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119107 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119108 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119109 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119110 order by id desc limit 1 Qualite : 0.20617911161510105 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20119111_31-01-2025_18_33_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119111 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119111 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119112 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119113 order by id desc limit 1 Qualite : 0.25044888642272845 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20119114_31-01-2025_18_17_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119114 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119114 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119335 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119336 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119337 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119338 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119339 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119340 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119341 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119342 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119343 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119344 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119345 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119346 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119347 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119348 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119349 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119350 order by id desc limit 1 Qualite : 0.21454922986087174 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20119351_31-01-2025_18_47_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119351 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119351 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119740 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119741 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119742 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119743 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119770 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119782 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119783 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119784 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119785 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119786 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119787 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119789 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119791 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119793 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119795 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119797 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119799 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119800 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119802 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119804 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119806 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119808 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119810 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119812 order by id desc limit 1 Qualite : 0.21446781006255577 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20119813_31-01-2025_19_40_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119813 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119813 AND mptpi.`type`=4230 To do Qualite : 0.16814914130885286 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20119814_31-01-2025_19_18_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119814 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119814 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120234 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120235 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120236 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120237 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120238 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120239 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120240 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120241 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120243 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120244 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120572 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120573 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120574 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120575 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120576 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120577 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120578 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120579 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120580 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120581 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120582 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120583 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120584 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120585 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120586 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120587 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120588 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120589 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120590 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120591 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120247 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120248 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120249 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120250 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120251 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120252 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120253 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120254 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120255 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120256 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120257 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120258 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120259 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120260 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120261 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120262 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120263 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120264 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120265 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120266 order by id desc limit 1 Qualite : 0.22127035710538484 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20120267_31-01-2025_19_48_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120267 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20120267 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120268 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120592 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120593 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120594 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120595 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120596 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120597 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120598 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120599 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120600 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120601 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120602 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120603 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120604 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120605 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120606 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120607 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120608 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120609 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120610 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120611 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120612 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120613 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120614 order by id desc limit 1 Qualite : 0.20803760148353112 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20120615_31-01-2025_20_32_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120615 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20120615 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120932 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120933 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120934 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120935 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120936 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120937 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120938 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120939 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120940 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120941 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120942 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120943 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120944 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120945 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120946 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120947 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120948 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120949 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120950 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120951 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120952 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120953 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120954 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120955 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121223 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121225 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121226 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121228 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121230 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121232 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121234 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121236 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121238 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121240 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121242 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121244 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121246 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121248 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121249 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121250 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121251 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121252 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121253 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121254 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121255 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121256 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121293 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121294 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121295 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121296 order by id desc limit 1 Qualite : 0.21380180788067177 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20121297_31-01-2025_21_35_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121297 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121297 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121298 order by id desc limit 1 Qualite : 0.21134396715307036 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20121299_31-01-2025_21_18_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121299 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121299 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121300 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122167 order by id desc limit 1 Qualite : 0.23016390066719183 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127274_01-02-2025_05_13_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127274 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127274 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127275 order by id desc limit 1 Qualite : 0.22395381094780312 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127276_01-02-2025_06_01_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127276 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127276 AND mptpi.`type`=4230 To do Qualite : 0.20750309685494503 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127277_01-02-2025_06_26_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127277 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127277 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122170 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122171 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122172 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122173 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122174 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122175 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122176 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122177 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122178 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122179 order by id desc limit 1 Qualite : 0.23284957561511838 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20122180_31-01-2025_21_49_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122180 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20122180 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122181 order by id desc limit 1 Qualite : 0.23112596477729677 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127278_01-02-2025_04_18_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127278 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127278 AND mptpi.`type`=4230 To do Qualite : 0.2277805082446173 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127279_01-02-2025_04_23_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127279 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127279 AND mptpi.`type`=4230 To do Qualite : 0.24813908175903673 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127280_01-02-2025_03_50_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127280 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127280 AND mptpi.`type`=4230 To do Qualite : 0.21818659201066368 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127281_01-02-2025_03_41_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127281 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127281 AND mptpi.`type`=4230 To do Qualite : 0.19463025646536283 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127282_01-02-2025_03_07_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127282 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127282 AND mptpi.`type`=4230 To do Qualite : 0.20875846811683288 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127283_01-02-2025_02_18_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127283 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127283 AND mptpi.`type`=4230 To do Qualite : 0.21310064590352304 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127284_01-02-2025_02_26_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127284 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127284 AND mptpi.`type`=4230 To do Qualite : 0.22321303428912254 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127285_01-02-2025_01_49_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127285 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127285 AND mptpi.`type`=4230 To do Qualite : 0.22430908149608844 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127286_01-02-2025_00_52_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127286 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127286 AND mptpi.`type`=4230 To do Qualite : 0.24309344249940346 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127287_01-02-2025_00_53_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127287 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127287 AND mptpi.`type`=4230 To do Qualite : 0.2258821297970158 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127302_01-02-2025_00_51_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127302 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127302 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123398 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123423 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123424 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123425 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123426 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123427 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123428 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123429 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123430 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123431 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123432 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123433 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123434 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123435 order by id desc limit 1 Qualite : 0.24394261262748643 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20123436_31-01-2025_22_33_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123436 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20123436 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123437 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123438 order by id desc limit 1 Qualite : 0.2256012896625769 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20123439_31-01-2025_22_18_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123439 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20123439 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124861 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124862 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124863 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124864 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124865 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124866 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124867 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124868 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124869 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124870 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124871 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124872 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124873 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124874 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124875 order by id desc limit 1 Qualite : 0.26730710181938827 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20124876_01-02-2025_06_23_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124876 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20124876 AND mptpi.`type`=4230 To do Qualite : 0.23199955808724257 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20124877_01-02-2025_06_04_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124877 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20124877 AND mptpi.`type`=4230 To do Qualite : 0.21109570840898997 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20124878_31-01-2025_23_48_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124878 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20124878 AND mptpi.`type`=4230 To do Qualite : 0.17361163724086415 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20124896_31-01-2025_23_34_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124896 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20124896 AND mptpi.`type`=4230 To do Qualite : 0.20118689386707925 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20124922_31-01-2025_22_51_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124922 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20124922 AND mptpi.`type`=4230 To do Qualite : 0.2484028433508808 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127303_01-02-2025_04_22_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127303 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127303 AND mptpi.`type`=4230 To do Qualite : 0.21067357955438912 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127304_01-02-2025_05_34_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127304 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127304 AND mptpi.`type`=4230 To do Qualite : 0.21373297021850063 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127305_01-02-2025_00_27_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127305 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127305 AND mptpi.`type`=4230 To do Qualite : 0.2047372684132672 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127306_01-02-2025_00_24_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127306 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127306 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'31012025': {'nb_upload': 2, 'nb_taggue_class': 2, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1333477138, 1333476998] Looping around the photos to save general results len do output : 1 /20124876Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535626') ('4234', '20124876', '1333477138', None, None, None, None, None, '2535626') ('4234', None, None, None, None, None, None, None, '2535626') ('4234', '20124876', '1333476998', None, None, None, None, None, '2535626') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.09296703338623047 save_final save missing photos in datou_result : time spend for datou_step_exec : 222.22251868247986 time spend to save output : 0.0932457447052002 total time spend for step 11 : 222.31576442718506 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 2 set_done_treatment 37.36user 25.50system 6:46.43elapsed 15%CPU (0avgtext+0avgdata 2958920maxresident)k 957232inputs+16848outputs (2216major+2684121minor)pagefaults 0swaps