python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2825438 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2542836'] with mtr_portfolio_ids : ['20196734'] and first list_photo_ids : [] new path : /proc/2825438/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 2 ; length of list_pids : 2 ; length of list_args : 2 time to download the photos : 0.30919814109802246 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Tue Feb 4 06:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5133 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-04 06:20:32.155704: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-04 06:20:32.187240: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-04 06:20:32.189366: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f4224000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-04 06:20:32.189426: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-04 06:20:32.193800: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-04 06:20:32.448647: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xdf21d60 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-04 06:20:32.448728: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-04 06:20:32.449694: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-04 06:20:32.450060: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-04 06:20:32.452200: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-04 06:20:32.454330: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-04 06:20:32.454705: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-04 06:20:32.456963: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-04 06:20:32.458043: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-04 06:20:32.462433: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-04 06:20:32.463744: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-04 06:20:32.463847: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-04 06:20:32.464502: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-04 06:20:32.464520: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-04 06:20:32.464530: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-04 06:20:32.465613: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4679 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-04 06:20:32.757781: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-04 06:20:32.757930: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-04 06:20:32.757959: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-04 06:20:32.757988: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-04 06:20:32.758014: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-04 06:20:32.758042: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-04 06:20:32.758066: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-04 06:20:32.758092: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-04 06:20:32.759732: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-04 06:20:32.761012: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-04 06:20:32.761083: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-04 06:20:32.761104: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-04 06:20:32.761123: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-04 06:20:32.761141: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-04 06:20:32.761160: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-04 06:20:32.761176: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-04 06:20:32.761193: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-04 06:20:32.762179: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-04 06:20:32.762218: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-04 06:20:32.762227: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-04 06:20:32.762235: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-04 06:20:32.763280: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4679 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-04 06:20:40.455931: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-04 06:20:40.652850: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-04 06:20:42.049432: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:42.050565: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:42.051818: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:42.925253: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-02-04 06:20:42.993961: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:42.994020: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-04 06:20:42.994732: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:42.994763: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-04 06:20:43.002242: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.002294: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-04 06:20:43.002960: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.002984: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-04 06:20:43.031895: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.032001: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 19.91MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-04 06:20:43.032048: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-02-04 06:20:43.033200: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.033237: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-04 06:20:43.034465: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.034501: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-04 06:20:43.041820: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.041871: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-04 06:20:43.042515: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.042532: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-04 06:20:43.043204: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.043223: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-04 06:20:43.043856: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.052438: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.053120: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.071221: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.072057: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.072762: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.073402: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.078480: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.079156: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.079796: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.080452: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.081597: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.091821: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.092487: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.102765: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.103447: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.104363: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.105034: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.105739: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-04 06:20:43.106397: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 2 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.16484 max: 147.76406 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 0.00011563301086425781 nb_pixel_total : 1193 time to create 1 rle with old method : 0.0022995471954345703 length of segment : 42 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 147 time to create 1 rle with old method : 0.0002899169921875 length of segment : 20 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 45 time to create 1 rle with old method : 0.00015473365783691406 length of segment : 14 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 875 time to create 1 rle with old method : 0.0016922950744628906 length of segment : 34 time for calcul the mask position with numpy : 0.00010228157043457031 nb_pixel_total : 827 time to create 1 rle with old method : 0.0015821456909179688 length of segment : 34 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.0006947517395019531 length of segment : 29 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 1455 time to create 1 rle with old method : 0.0027866363525390625 length of segment : 41 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 37 time to create 1 rle with old method : 7.748603820800781e-05 length of segment : 10 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 69 time to create 1 rle with old method : 0.00017189979553222656 length of segment : 23 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 148 time to create 1 rle with old method : 0.0003268718719482422 length of segment : 19 time for calcul the mask position with numpy : 0.0002090930938720703 nb_pixel_total : 1392 time to create 1 rle with old method : 0.0018541812896728516 length of segment : 50 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 874 time to create 1 rle with old method : 0.0012671947479248047 length of segment : 34 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 14 time to create 1 rle with old method : 8.344650268554688e-05 length of segment : 3 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.33672 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 2243 time to create 1 rle with old method : 0.0031528472900390625 length of segment : 49 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 905 time to create 1 rle with old method : 0.0014722347259521484 length of segment : 36 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.43047 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 1299 time to create 1 rle with old method : 0.0019519329071044922 length of segment : 21 time for calcul the mask position with numpy : 0.00012636184692382812 nb_pixel_total : 3741 time to create 1 rle with old method : 0.005020618438720703 length of segment : 119 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 772 time to create 1 rle with old method : 0.0010943412780761719 length of segment : 54 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 1437 time to create 1 rle with old method : 0.0021321773529052734 length of segment : 49 time for calcul the mask position with numpy : 8.368492126464844e-05 nb_pixel_total : 1562 time to create 1 rle with old method : 0.0024704933166503906 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.44609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 0.00015091896057128906 nb_pixel_total : 7902 time to create 1 rle with old method : 0.011255025863647461 length of segment : 151 time for calcul the mask position with numpy : 0.00011277198791503906 nb_pixel_total : 802 time to create 1 rle with old method : 0.0015430450439453125 length of segment : 48 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.0005526542663574219 length of segment : 21 time for calcul the mask position with numpy : 0.00018405914306640625 nb_pixel_total : 4025 time to create 1 rle with old method : 0.007516384124755859 length of segment : 172 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.000484466552734375 length of segment : 19 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.00033736228942871094 length of segment : 18 time for calcul the mask position with numpy : 8.749961853027344e-05 nb_pixel_total : 978 time to create 1 rle with old method : 0.0014019012451171875 length of segment : 169 time for calcul the mask position with numpy : 0.0003886222839355469 nb_pixel_total : 7395 time to create 1 rle with old method : 0.008971214294433594 length of segment : 291 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.42422 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 530 time to create 1 rle with old method : 0.0007762908935546875 length of segment : 21 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 560 time to create 1 rle with old method : 0.0007970333099365234 length of segment : 31 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1781 time to create 1 rle with old method : 0.002423524856567383 length of segment : 138 time for calcul the mask position with numpy : 0.0006153583526611328 nb_pixel_total : 48590 time to create 1 rle with old method : 0.06632757186889648 length of segment : 238 time for calcul the mask position with numpy : 0.00015091896057128906 nb_pixel_total : 1983 time to create 1 rle with old method : 0.0038366317749023438 length of segment : 127 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 580 time to create 1 rle with old method : 0.0008521080017089844 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 21.00000 max: 218.00000 molded_images shape: (1, 640, 640, 3) min: -86.93438 max: 88.74453 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.07891 max: 150.36172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.00018024444580078125 length of segment : 19 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 792 time to create 1 rle with old method : 0.0011043548583984375 length of segment : 32 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.0002117156982421875 length of segment : 12 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 967 time to create 1 rle with old method : 0.0013074874877929688 length of segment : 67 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 701 time to create 1 rle with old method : 0.0010340213775634766 length of segment : 27 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 529 time to create 1 rle with old method : 0.0007770061492919922 length of segment : 24 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005524158477783203 length of segment : 47 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 694 time to create 1 rle with old method : 0.0009751319885253906 length of segment : 26 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.0003235340118408203 length of segment : 19 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.00027179718017578125 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.59063 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.0003275871276855469 nb_pixel_total : 19252 time to create 1 rle with old method : 0.031317710876464844 length of segment : 156 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.0002009868621826172 length of segment : 10 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 508 time to create 1 rle with old method : 0.0007522106170654297 length of segment : 20 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.0001647472381591797 length of segment : 9 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.0004811286926269531 length of segment : 34 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0005056858062744141 length of segment : 22 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.23125 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 860 time to create 1 rle with old method : 0.0011086463928222656 length of segment : 38 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 1852 time to create 1 rle with old method : 0.0023620128631591797 length of segment : 121 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.0003771781921386719 length of segment : 22 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 773 time to create 1 rle with old method : 0.0010044574737548828 length of segment : 50 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 1211 time to create 1 rle with old method : 0.0016639232635498047 length of segment : 42 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0006220340728759766 length of segment : 55 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002613067626953125 length of segment : 29 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 1350 time to create 1 rle with old method : 0.0017840862274169922 length of segment : 43 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 1270 time to create 1 rle with old method : 0.0018198490142822266 length of segment : 43 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.06875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 339 time to create 1 rle with old method : 0.0005242824554443359 length of segment : 25 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 371 time to create 1 rle with old method : 0.0005676746368408203 length of segment : 31 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 1828 time to create 1 rle with old method : 0.0024094581604003906 length of segment : 84 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1241 time to create 1 rle with old method : 0.0016832351684570312 length of segment : 57 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 767 time to create 1 rle with old method : 0.0009932518005371094 length of segment : 44 time for calcul the mask position with numpy : 9.369850158691406e-05 nb_pixel_total : 924 time to create 1 rle with old method : 0.0012598037719726562 length of segment : 79 time for calcul the mask position with numpy : 0.0002651214599609375 nb_pixel_total : 4194 time to create 1 rle with old method : 0.00590968132019043 length of segment : 188 time for calcul the mask position with numpy : 0.00029349327087402344 nb_pixel_total : 4789 time to create 1 rle with old method : 0.006036520004272461 length of segment : 232 time for calcul the mask position with numpy : 0.000209808349609375 nb_pixel_total : 4600 time to create 1 rle with old method : 0.005420684814453125 length of segment : 212 Processing 1 images image shape: (280, 400, 3) min: 22.00000 max: 193.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 73.97891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0010135173797607422 nb_pixel_total : 106264 time to create 1 rle with old method : 0.11806583404541016 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.85781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 983 time to create 1 rle with old method : 0.0013132095336914062 length of segment : 60 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.0002803802490234375 length of segment : 12 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.0002193450927734375 length of segment : 15 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 350 time to create 1 rle with old method : 0.0005097389221191406 length of segment : 18 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.76016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 29 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0003142356872558594 length of segment : 14 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.0004982948303222656 length of segment : 18 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.00030303001403808594 length of segment : 20 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.00033783912658691406 length of segment : 17 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.00028395652770996094 length of segment : 18 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 663 time to create 1 rle with old method : 0.0009765625 length of segment : 27 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.0003361701965332031 length of segment : 16 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 1364 time to create 1 rle with old method : 0.0017628669738769531 length of segment : 56 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.0003120899200439453 length of segment : 15 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 144 time to create 1 rle with old method : 0.0002980232238769531 length of segment : 14 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 41 time to create 1 rle with old method : 0.00016617774963378906 length of segment : 6 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 718 time to create 1 rle with old method : 0.0013585090637207031 length of segment : 29 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 412 time to create 1 rle with old method : 0.0007467269897460938 length of segment : 24 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 737 time to create 1 rle with old method : 0.0014536380767822266 length of segment : 33 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 335 time to create 1 rle with old method : 0.0006020069122314453 length of segment : 32 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 343 time to create 1 rle with old method : 0.0007188320159912109 length of segment : 41 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.0005779266357421875 length of segment : 23 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.00035953521728515625 length of segment : 15 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 138 time to create 1 rle with old method : 0.0002982616424560547 length of segment : 20 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.0004696846008300781 length of segment : 19 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 81 time to create 1 rle with old method : 0.00016880035400390625 length of segment : 14 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 115 time to create 1 rle with old method : 0.00025463104248046875 length of segment : 11 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.00038433074951171875 length of segment : 30 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 627 time to create 1 rle with old method : 0.0010602474212646484 length of segment : 43 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 626 time to create 1 rle with old method : 0.0011856555938720703 length of segment : 25 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.0003407001495361328 length of segment : 15 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 864 time to create 1 rle with old method : 0.001638650894165039 length of segment : 34 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 490 time to create 1 rle with old method : 0.00089263916015625 length of segment : 24 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0005257129669189453 length of segment : 24 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.51797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 20 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 866 time to create 1 rle with old method : 0.0014619827270507812 length of segment : 52 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.00024366378784179688 length of segment : 17 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.0003123283386230469 length of segment : 26 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.00028443336486816406 length of segment : 16 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.00032019615173339844 length of segment : 18 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 385 time to create 1 rle with old method : 0.0005860328674316406 length of segment : 19 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 10 time to create 1 rle with old method : 8.058547973632812e-05 length of segment : 7 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 530 time to create 1 rle with old method : 0.0007953643798828125 length of segment : 25 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 960 time to create 1 rle with old method : 0.0013103485107421875 length of segment : 54 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 655 time to create 1 rle with old method : 0.0009663105010986328 length of segment : 36 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.0002224445343017578 length of segment : 14 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 635 time to create 1 rle with old method : 0.0009181499481201172 length of segment : 32 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.00011801719665527344 length of segment : 9 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.00043463706970214844 length of segment : 22 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 309 time to create 1 rle with old method : 0.0004241466522216797 length of segment : 28 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 1028 time to create 1 rle with old method : 0.0013856887817382812 length of segment : 41 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 421 time to create 1 rle with old method : 0.0006520748138427734 length of segment : 32 time for calcul the mask position with numpy : 0.00011873245239257812 nb_pixel_total : 2871 time to create 1 rle with old method : 0.0038166046142578125 length of segment : 68 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 445 time to create 1 rle with old method : 0.0006732940673828125 length of segment : 22 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 604 time to create 1 rle with old method : 0.0008449554443359375 length of segment : 31 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 132.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 8.368492126464844e-05 nb_pixel_total : 144 time to create 1 rle with old method : 0.0004878044128417969 length of segment : 62 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 219 time to create 1 rle with old method : 0.0005221366882324219 length of segment : 17 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.81328 max: 147.76406 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 383 time to create 1 rle with old method : 0.0007951259613037109 length of segment : 32 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 65 time to create 1 rle with old method : 0.00019598007202148438 length of segment : 17 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 884 time to create 1 rle with old method : 0.0016071796417236328 length of segment : 35 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 873 time to create 1 rle with old method : 0.001622915267944336 length of segment : 34 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 874 time to create 1 rle with old method : 0.0017940998077392578 length of segment : 32 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 20 time to create 1 rle with old method : 7.557868957519531e-05 length of segment : 14 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0007777214050292969 length of segment : 34 time for calcul the mask position with numpy : 8.726119995117188e-05 nb_pixel_total : 1542 time to create 1 rle with old method : 0.0033140182495117188 length of segment : 57 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.0005764961242675781 length of segment : 36 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.58672 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 40 time to create 1 rle with old method : 0.00012159347534179688 length of segment : 7 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 2129 time to create 1 rle with old method : 0.0027832984924316406 length of segment : 48 time for calcul the mask position with numpy : 7.677078247070312e-05 nb_pixel_total : 1254 time to create 1 rle with old method : 0.0017333030700683594 length of segment : 42 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 331 time to create 1 rle with old method : 0.0004820823669433594 length of segment : 31 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 343 time to create 1 rle with old method : 0.0005486011505126953 length of segment : 48 time for calcul the mask position with numpy : 0.00012493133544921875 nb_pixel_total : 2416 time to create 1 rle with old method : 0.0030541419982910156 length of segment : 52 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 905 time to create 1 rle with old method : 0.001247406005859375 length of segment : 40 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.24688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.00011587142944335938 nb_pixel_total : 4218 time to create 1 rle with old method : 0.005197286605834961 length of segment : 137 time for calcul the mask position with numpy : 0.00011014938354492188 nb_pixel_total : 1872 time to create 1 rle with old method : 0.002578258514404297 length of segment : 85 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.39531 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00014328956604003906 nb_pixel_total : 8864 time to create 1 rle with old method : 0.010782241821289062 length of segment : 124 time for calcul the mask position with numpy : 0.00011229515075683594 nb_pixel_total : 3415 time to create 1 rle with old method : 0.004547595977783203 length of segment : 146 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 637 time to create 1 rle with old method : 0.0008511543273925781 length of segment : 60 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 215 time to create 1 rle with old method : 0.00033402442932128906 length of segment : 20 time for calcul the mask position with numpy : 0.0002620220184326172 nb_pixel_total : 6055 time to create 1 rle with old method : 0.007491350173950195 length of segment : 267 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002856254577636719 length of segment : 16 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.00035309791564941406 length of segment : 17 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.08828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 1406 time to create 1 rle with old method : 0.0017786026000976562 length of segment : 131 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 429 time to create 1 rle with old method : 0.0006475448608398438 length of segment : 17 time for calcul the mask position with numpy : 0.00012612342834472656 nb_pixel_total : 3498 time to create 1 rle with old method : 0.004506111145019531 length of segment : 61 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 319 time to create 1 rle with old method : 0.0004413127899169922 length of segment : 32 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 542 time to create 1 rle with old method : 0.0007684230804443359 length of segment : 29 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 519 time to create 1 rle with old method : 0.0007030963897705078 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 24.00000 max: 219.00000 molded_images shape: (1, 640, 640, 3) min: -85.76641 max: 89.18984 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.65313 max: 151.02969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.00021338462829589844 length of segment : 12 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.00018262863159179688 length of segment : 20 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 524 time to create 1 rle with old method : 0.0007107257843017578 length of segment : 44 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 564 time to create 1 rle with old method : 0.0007829666137695312 length of segment : 29 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 553 time to create 1 rle with old method : 0.0008151531219482422 length of segment : 24 time for calcul the mask position with numpy : 0.00017523765563964844 nb_pixel_total : 9102 time to create 1 rle with old method : 0.011194944381713867 length of segment : 128 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.0003349781036376953 length of segment : 15 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 794 time to create 1 rle with old method : 0.0011525154113769531 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.53203 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 490 time to create 1 rle with old method : 0.0007138252258300781 length of segment : 19 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 99 time to create 1 rle with old method : 0.00018906593322753906 length of segment : 9 time for calcul the mask position with numpy : 0.00021195411682128906 nb_pixel_total : 16005 time to create 1 rle with old method : 0.01926112174987793 length of segment : 132 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.00029397010803222656 length of segment : 16 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 91 time to create 1 rle with old method : 0.0001723766326904297 length of segment : 9 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.55156 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 839 time to create 1 rle with old method : 0.0011093616485595703 length of segment : 36 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 1216 time to create 1 rle with old method : 0.0017414093017578125 length of segment : 43 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 737 time to create 1 rle with old method : 0.0010471343994140625 length of segment : 52 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 448 time to create 1 rle with old method : 0.0006396770477294922 length of segment : 42 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 1637 time to create 1 rle with old method : 0.0022153854370117188 length of segment : 38 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1345 time to create 1 rle with old method : 0.0017385482788085938 length of segment : 42 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.00026869773864746094 length of segment : 26 time for calcul the mask position with numpy : 0.0001227855682373047 nb_pixel_total : 1318 time to create 1 rle with old method : 0.001834869384765625 length of segment : 116 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 450 time to create 1 rle with old method : 0.0006706714630126953 length of segment : 46 time for calcul the mask position with numpy : 8.988380432128906e-05 nb_pixel_total : 1571 time to create 1 rle with old method : 0.0020117759704589844 length of segment : 106 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006451606750488281 length of segment : 53 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 416 time to create 1 rle with old method : 0.0005524158477783203 length of segment : 46 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 1287 time to create 1 rle with old method : 0.0016467571258544922 length of segment : 40 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.51406 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 326 time to create 1 rle with old method : 0.0005052089691162109 length of segment : 17 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 348 time to create 1 rle with old method : 0.0005202293395996094 length of segment : 30 time for calcul the mask position with numpy : 0.00012683868408203125 nb_pixel_total : 1822 time to create 1 rle with old method : 0.0023946762084960938 length of segment : 85 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 797 time to create 1 rle with old method : 0.0011742115020751953 length of segment : 35 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 785 time to create 1 rle with old method : 0.0010666847229003906 length of segment : 46 time for calcul the mask position with numpy : 0.0003731250762939453 nb_pixel_total : 4069 time to create 1 rle with old method : 0.005838871002197266 length of segment : 160 time for calcul the mask position with numpy : 0.00034308433532714844 nb_pixel_total : 4481 time to create 1 rle with old method : 0.005933523178100586 length of segment : 211 time for calcul the mask position with numpy : 0.00029468536376953125 nb_pixel_total : 1006 time to create 1 rle with old method : 0.0014345645904541016 length of segment : 122 Processing 1 images image shape: (280, 400, 3) min: 15.00000 max: 196.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 73.97891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0012009143829345703 nb_pixel_total : 106479 time to create 1 rle with old method : 0.12118077278137207 length of segment : 279 time for calcul the mask position with numpy : 0.0001266002655029297 nb_pixel_total : 364 time to create 1 rle with old method : 0.0006783008575439453 length of segment : 43 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.90078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 846 time to create 1 rle with old method : 0.0012640953063964844 length of segment : 58 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 154 time to create 1 rle with old method : 0.00025391578674316406 length of segment : 15 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.0004601478576660156 length of segment : 22 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 352 time to create 1 rle with old method : 0.0005860328674316406 length of segment : 18 time for calcul the mask position with numpy : 8.678436279296875e-05 nb_pixel_total : 1074 time to create 1 rle with old method : 0.0015265941619873047 length of segment : 56 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.71328 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 29 time for calcul the mask position with numpy : 9.655952453613281e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.00029587745666503906 length of segment : 14 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 344 time to create 1 rle with old method : 0.0006563663482666016 length of segment : 19 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.00033736228942871094 length of segment : 16 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 199 time to create 1 rle with old method : 0.0003409385681152344 length of segment : 16 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 155 time to create 1 rle with old method : 0.00026535987854003906 length of segment : 16 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.0003337860107421875 length of segment : 21 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.0002586841583251953 length of segment : 16 time for calcul the mask position with numpy : 0.00010442733764648438 nb_pixel_total : 713 time to create 1 rle with old method : 0.0009944438934326172 length of segment : 30 time for calcul the mask position with numpy : 0.00010156631469726562 nb_pixel_total : 1498 time to create 1 rle with old method : 0.0020449161529541016 length of segment : 55 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0003516674041748047 length of segment : 16 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.0003814697265625 length of segment : 28 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.00028324127197265625 length of segment : 16 time for calcul the mask position with numpy : 7.939338684082031e-05 nb_pixel_total : 727 time to create 1 rle with old method : 0.001065969467163086 length of segment : 31 time for calcul the mask position with numpy : 0.00010943412780761719 nb_pixel_total : 265 time to create 1 rle with old method : 0.0005621910095214844 length of segment : 20 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.0003666877746582031 length of segment : 14 time for calcul the mask position with numpy : 8.893013000488281e-05 nb_pixel_total : 598 time to create 1 rle with old method : 0.000965118408203125 length of segment : 30 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 613 time to create 1 rle with old method : 0.0008783340454101562 length of segment : 40 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 76 time to create 1 rle with old method : 0.00014901161193847656 length of segment : 14 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.0003447532653808594 length of segment : 13 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.00023317337036132812 length of segment : 13 time for calcul the mask position with numpy : 9.1552734375e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.00027251243591308594 length of segment : 24 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.0003039836883544922 length of segment : 17 time for calcul the mask position with numpy : 0.00013589859008789062 nb_pixel_total : 575 time to create 1 rle with old method : 0.0012516975402832031 length of segment : 24 time for calcul the mask position with numpy : 0.0001277923583984375 nb_pixel_total : 408 time to create 1 rle with old method : 0.0011355876922607422 length of segment : 18 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.0003733634948730469 length of segment : 14 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 697 time to create 1 rle with old method : 0.0010230541229248047 length of segment : 34 time for calcul the mask position with numpy : 0.00010442733764648438 nb_pixel_total : 631 time to create 1 rle with old method : 0.001065969467163086 length of segment : 25 time for calcul the mask position with numpy : 0.0001308917999267578 nb_pixel_total : 1331 time to create 1 rle with old method : 0.0018532276153564453 length of segment : 53 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 497 time to create 1 rle with old method : 0.0007817745208740234 length of segment : 25 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.60000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 0.00011754035949707031 nb_pixel_total : 852 time to create 1 rle with old method : 0.0012226104736328125 length of segment : 54 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 434 time to create 1 rle with old method : 0.0007083415985107422 length of segment : 26 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 598 time to create 1 rle with old method : 0.0009109973907470703 length of segment : 36 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 172 time to create 1 rle with old method : 0.0003638267517089844 length of segment : 17 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 451 time to create 1 rle with old method : 0.0006573200225830078 length of segment : 29 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003840923309326172 length of segment : 29 time for calcul the mask position with numpy : 0.0001575946807861328 nb_pixel_total : 149 time to create 1 rle with old method : 0.0002949237823486328 length of segment : 27 time for calcul the mask position with numpy : 0.0001087188720703125 nb_pixel_total : 932 time to create 1 rle with old method : 0.0013289451599121094 length of segment : 46 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 699 time to create 1 rle with old method : 0.001005411148071289 length of segment : 33 time for calcul the mask position with numpy : 9.34600830078125e-05 nb_pixel_total : 1071 time to create 1 rle with old method : 0.0015022754669189453 length of segment : 58 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 463 time to create 1 rle with old method : 0.0006866455078125 length of segment : 21 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 64 time to create 1 rle with old method : 0.00014638900756835938 length of segment : 9 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.00022554397583007812 length of segment : 22 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.0003573894500732422 length of segment : 17 time for calcul the mask position with numpy : 0.00012493133544921875 nb_pixel_total : 1522 time to create 1 rle with old method : 0.0020444393157958984 length of segment : 87 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 253.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.28750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 9.775161743164062e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.0004000663757324219 length of segment : 64 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.0003490447998046875 length of segment : 14 time for calcul the mask position with numpy : 0.0005800724029541016 nb_pixel_total : 38846 time to create 1 rle with old method : 0.04933500289916992 length of segment : 346 Detection mask done ! Trying to reset tf kernel 2825827 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2745 tf kernel not reseted sub process len(results) : 243 len(list_Values) 243 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 243 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3938 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 243 chid ids of type : 4228 Number RLEs to save : 11530 save missing photos in datou_result : time spend for datou_step_exec : 23.63898491859436 time spend to save output : 1.0674102306365967 total time spend for step 1 : 24.706395149230957 step2:brightness Tue Feb 4 06:20:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1738646429_2825438_1334205130_0378882dbc4dad266bd74241fbb30eb5.jpg treat image : temp/1738646429_2825438_1334205125_f6f5fd6c359c600d75fbf79fc8b57b04.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.013640880584716797 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.013009309768676758 save missing photos in datou_result : time spend for datou_step_exec : 0.5199563503265381 time spend to save output : 0.03153491020202637 total time spend for step 2 : 0.5514912605285645 step3:blur_detection Tue Feb 4 06:20:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1738646429_2825438_1334205130_0378882dbc4dad266bd74241fbb30eb5.jpg resize: (1080, 1920) 1334205130 -8.023341782334327 treat image : temp/1738646429_2825438_1334205125_f6f5fd6c359c600d75fbf79fc8b57b04.jpg resize: (1080, 1920) 1334205125 -8.02020809744936 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.013758659362792969 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.056777000427246094 save missing photos in datou_result : time spend for datou_step_exec : 2.2991623878479004 time spend to save output : 0.07560133934020996 total time spend for step 3 : 2.3747637271881104 step4:rle_unique_nms_with_priority Tue Feb 4 06:20:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 243 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 124 nb_hashtags : 7 time to prepare the origin masks : 1.0199503898620605 time for calcul the mask position with numpy : 0.06135058403015137 nb_pixel_total : 1817703 time to create 1 rle with new method : 0.34418416023254395 time for calcul the mask position with numpy : 0.00856471061706543 nb_pixel_total : 1781 time to create 1 rle with old method : 0.0021207332611083984 time for calcul the mask position with numpy : 0.008553743362426758 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003705024719238281 time for calcul the mask position with numpy : 0.008631229400634766 nb_pixel_total : 48590 time to create 1 rle with old method : 0.05599164962768555 time for calcul the mask position with numpy : 0.009589433670043945 nb_pixel_total : 4025 time to create 1 rle with old method : 0.00481104850769043 time for calcul the mask position with numpy : 0.008544921875 nb_pixel_total : 875 time to create 1 rle with old method : 0.0010826587677001953 time for calcul the mask position with numpy : 0.008555412292480469 nb_pixel_total : 21 time to create 1 rle with old method : 7.605552673339844e-05 time for calcul the mask position with numpy : 0.008516311645507812 nb_pixel_total : 47 time to create 1 rle with old method : 0.00010633468627929688 time for calcul the mask position with numpy : 0.008559942245483398 nb_pixel_total : 214 time to create 1 rle with old method : 0.00029921531677246094 time for calcul the mask position with numpy : 0.008614778518676758 nb_pixel_total : 2836 time to create 1 rle with old method : 0.0035207271575927734 time for calcul the mask position with numpy : 0.008538484573364258 nb_pixel_total : 45 time to create 1 rle with old method : 8.082389831542969e-05 time for calcul the mask position with numpy : 0.008579254150390625 nb_pixel_total : 23 time to create 1 rle with old method : 4.9591064453125e-05 time for calcul the mask position with numpy : 0.008562088012695312 nb_pixel_total : 1455 time to create 1 rle with old method : 0.0017590522766113281 time for calcul the mask position with numpy : 0.008597373962402344 nb_pixel_total : 147 time to create 1 rle with old method : 0.00019884109497070312 time for calcul the mask position with numpy : 0.008584737777709961 nb_pixel_total : 148 time to create 1 rle with old method : 0.00022554397583007812 time for calcul the mask position with numpy : 0.008590221405029297 nb_pixel_total : 4 time to create 1 rle with old method : 2.6702880859375e-05 time for calcul the mask position with numpy : 0.008659124374389648 nb_pixel_total : 14 time to create 1 rle with old method : 5.5789947509765625e-05 time for calcul the mask position with numpy : 0.008560419082641602 nb_pixel_total : 2243 time to create 1 rle with old method : 0.0027005672454833984 time for calcul the mask position with numpy : 0.008563756942749023 nb_pixel_total : 772 time to create 1 rle with old method : 0.0009982585906982422 time for calcul the mask position with numpy : 0.008565187454223633 nb_pixel_total : 905 time to create 1 rle with old method : 0.001165628433227539 time for calcul the mask position with numpy : 0.008630037307739258 nb_pixel_total : 802 time to create 1 rle with old method : 0.0009903907775878906 time for calcul the mask position with numpy : 0.00855875015258789 nb_pixel_total : 500 time to create 1 rle with old method : 0.0006468296051025391 time for calcul the mask position with numpy : 0.008489131927490234 nb_pixel_total : 237 time to create 1 rle with old method : 0.0002949237823486328 time for calcul the mask position with numpy : 0.008674860000610352 nb_pixel_total : 1193 time to create 1 rle with old method : 0.0014586448669433594 time for calcul the mask position with numpy : 0.008600473403930664 nb_pixel_total : 283 time to create 1 rle with old method : 0.0003974437713623047 time for calcul the mask position with numpy : 0.00850820541381836 nb_pixel_total : 978 time to create 1 rle with old method : 0.0012013912200927734 time for calcul the mask position with numpy : 0.008376359939575195 nb_pixel_total : 202 time to create 1 rle with old method : 0.00024247169494628906 time for calcul the mask position with numpy : 0.008712291717529297 nb_pixel_total : 1299 time to create 1 rle with old method : 0.0016260147094726562 time for calcul the mask position with numpy : 0.010216474533081055 nb_pixel_total : 274 time to create 1 rle with old method : 0.0004627704620361328 time for calcul the mask position with numpy : 0.008310317993164062 nb_pixel_total : 3741 time to create 1 rle with old method : 0.004178762435913086 time for calcul the mask position with numpy : 0.008311271667480469 nb_pixel_total : 7902 time to create 1 rle with old method : 0.009266376495361328 time for calcul the mask position with numpy : 0.00835561752319336 nb_pixel_total : 32 time to create 1 rle with old method : 6.318092346191406e-05 time for calcul the mask position with numpy : 0.008354663848876953 nb_pixel_total : 560 time to create 1 rle with old method : 0.0006756782531738281 time for calcul the mask position with numpy : 0.008363008499145508 nb_pixel_total : 1437 time to create 1 rle with old method : 0.0017185211181640625 time for calcul the mask position with numpy : 0.008385896682739258 nb_pixel_total : 530 time to create 1 rle with old method : 0.0006380081176757812 time for calcul the mask position with numpy : 0.008355855941772461 nb_pixel_total : 773 time to create 1 rle with old method : 0.0009284019470214844 time for calcul the mask position with numpy : 0.008394002914428711 nb_pixel_total : 90 time to create 1 rle with old method : 0.00011849403381347656 time for calcul the mask position with numpy : 0.00836038589477539 nb_pixel_total : 233 time to create 1 rle with old method : 0.0002779960632324219 time for calcul the mask position with numpy : 0.008487224578857422 nb_pixel_total : 860 time to create 1 rle with old method : 0.0010495185852050781 time for calcul the mask position with numpy : 0.008563518524169922 nb_pixel_total : 19252 time to create 1 rle with old method : 0.022269010543823242 time for calcul the mask position with numpy : 0.008473634719848633 nb_pixel_total : 181 time to create 1 rle with old method : 0.00022983551025390625 time for calcul the mask position with numpy : 0.008481979370117188 nb_pixel_total : 468 time to create 1 rle with old method : 0.0005900859832763672 time for calcul the mask position with numpy : 0.008426666259765625 nb_pixel_total : 1350 time to create 1 rle with old method : 0.0016155242919921875 time for calcul the mask position with numpy : 0.008421659469604492 nb_pixel_total : 767 time to create 1 rle with old method : 0.0009608268737792969 time for calcul the mask position with numpy : 0.008426189422607422 nb_pixel_total : 371 time to create 1 rle with old method : 0.0004734992980957031 time for calcul the mask position with numpy : 0.00844120979309082 nb_pixel_total : 792 time to create 1 rle with old method : 0.0009958744049072266 time for calcul the mask position with numpy : 0.008388757705688477 nb_pixel_total : 806 time to create 1 rle with old method : 0.0010116100311279297 time for calcul the mask position with numpy : 0.008922100067138672 nb_pixel_total : 924 time to create 1 rle with old method : 0.0019915103912353516 time for calcul the mask position with numpy : 0.008826732635498047 nb_pixel_total : 339 time to create 1 rle with old method : 0.00042510032653808594 time for calcul the mask position with numpy : 0.00861215591430664 nb_pixel_total : 4194 time to create 1 rle with old method : 0.005438804626464844 time for calcul the mask position with numpy : 0.009981632232666016 nb_pixel_total : 109 time to create 1 rle with old method : 0.00019621849060058594 time for calcul the mask position with numpy : 0.008389472961425781 nb_pixel_total : 1852 time to create 1 rle with old method : 0.002229928970336914 time for calcul the mask position with numpy : 0.008410453796386719 nb_pixel_total : 329 time to create 1 rle with old method : 0.0004115104675292969 time for calcul the mask position with numpy : 0.008413553237915039 nb_pixel_total : 109 time to create 1 rle with old method : 0.00014090538024902344 time for calcul the mask position with numpy : 0.00844717025756836 nb_pixel_total : 701 time to create 1 rle with old method : 0.0008492469787597656 time for calcul the mask position with numpy : 0.00850224494934082 nb_pixel_total : 694 time to create 1 rle with old method : 0.0008680820465087891 time for calcul the mask position with numpy : 0.008530616760253906 nb_pixel_total : 1241 time to create 1 rle with old method : 0.0015170574188232422 time for calcul the mask position with numpy : 0.008567571640014648 nb_pixel_total : 5 time to create 1 rle with old method : 3.719329833984375e-05 time for calcul the mask position with numpy : 0.008545398712158203 nb_pixel_total : 90 time to create 1 rle with old method : 0.00021982192993164062 time for calcul the mask position with numpy : 0.008593082427978516 nb_pixel_total : 201 time to create 1 rle with old method : 0.0002880096435546875 time for calcul the mask position with numpy : 0.008515596389770508 nb_pixel_total : 1211 time to create 1 rle with old method : 0.0014808177947998047 time for calcul the mask position with numpy : 0.008601188659667969 nb_pixel_total : 529 time to create 1 rle with old method : 0.0006630420684814453 time for calcul the mask position with numpy : 0.008552789688110352 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005228519439697266 time for calcul the mask position with numpy : 0.008560895919799805 nb_pixel_total : 967 time to create 1 rle with old method : 0.0012481212615966797 time for calcul the mask position with numpy : 0.008598566055297852 nb_pixel_total : 1828 time to create 1 rle with old method : 0.0021409988403320312 time for calcul the mask position with numpy : 0.008609533309936523 nb_pixel_total : 275 time to create 1 rle with old method : 0.0003597736358642578 time for calcul the mask position with numpy : 0.008448362350463867 nb_pixel_total : 129 time to create 1 rle with old method : 0.0001804828643798828 time for calcul the mask position with numpy : 0.008440732955932617 nb_pixel_total : 109 time to create 1 rle with old method : 0.00014400482177734375 time for calcul the mask position with numpy : 0.008393049240112305 nb_pixel_total : 508 time to create 1 rle with old method : 0.0006253719329833984 time for calcul the mask position with numpy : 0.008812904357910156 nb_pixel_total : 106264 time to create 1 rle with old method : 0.11955499649047852 time for calcul the mask position with numpy : 0.008454322814941406 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002627372741699219 time for calcul the mask position with numpy : 0.008380889892578125 nb_pixel_total : 208 time to create 1 rle with old method : 0.0002713203430175781 time for calcul the mask position with numpy : 0.00838923454284668 nb_pixel_total : 144 time to create 1 rle with old method : 0.00023865699768066406 time for calcul the mask position with numpy : 0.008453369140625 nb_pixel_total : 866 time to create 1 rle with old method : 0.001071929931640625 time for calcul the mask position with numpy : 0.008424043655395508 nb_pixel_total : 158 time to create 1 rle with old method : 0.00020074844360351562 time for calcul the mask position with numpy : 0.008424758911132812 nb_pixel_total : 385 time to create 1 rle with old method : 0.0004928112030029297 time for calcul the mask position with numpy : 0.008399724960327148 nb_pixel_total : 718 time to create 1 rle with old method : 0.0009014606475830078 time for calcul the mask position with numpy : 0.008438348770141602 nb_pixel_total : 350 time to create 1 rle with old method : 0.0004630088806152344 time for calcul the mask position with numpy : 0.008470535278320312 nb_pixel_total : 737 time to create 1 rle with old method : 0.0008761882781982422 time for calcul the mask position with numpy : 0.008442401885986328 nb_pixel_total : 317 time to create 1 rle with old method : 0.00039458274841308594 time for calcul the mask position with numpy : 0.008593082427978516 nb_pixel_total : 238 time to create 1 rle with old method : 0.00032830238342285156 time for calcul the mask position with numpy : 0.008548974990844727 nb_pixel_total : 412 time to create 1 rle with old method : 0.0005140304565429688 time for calcul the mask position with numpy : 0.008552074432373047 nb_pixel_total : 94 time to create 1 rle with old method : 0.0001499652862548828 time for calcul the mask position with numpy : 0.00852823257446289 nb_pixel_total : 115 time to create 1 rle with old method : 0.00017595291137695312 time for calcul the mask position with numpy : 0.008567571640014648 nb_pixel_total : 52 time to create 1 rle with old method : 9.322166442871094e-05 time for calcul the mask position with numpy : 0.008571147918701172 nb_pixel_total : 62 time to create 1 rle with old method : 0.00010204315185546875 time for calcul the mask position with numpy : 0.008452415466308594 nb_pixel_total : 421 time to create 1 rle with old method : 0.0005536079406738281 time for calcul the mask position with numpy : 0.008477926254272461 nb_pixel_total : 2867 time to create 1 rle with old method : 0.0034270286560058594 time for calcul the mask position with numpy : 0.008409976959228516 nb_pixel_total : 144 time to create 1 rle with old method : 0.0001823902130126953 time for calcul the mask position with numpy : 0.008421659469604492 nb_pixel_total : 1028 time to create 1 rle with old method : 0.0012440681457519531 time for calcul the mask position with numpy : 0.008412361145019531 nb_pixel_total : 1364 time to create 1 rle with old method : 0.0016474723815917969 time for calcul the mask position with numpy : 0.008381128311157227 nb_pixel_total : 280 time to create 1 rle with old method : 0.0003676414489746094 time for calcul the mask position with numpy : 0.008399248123168945 nb_pixel_total : 626 time to create 1 rle with old method : 0.000782012939453125 time for calcul the mask position with numpy : 0.008462905883789062 nb_pixel_total : 175 time to create 1 rle with old method : 0.0002307891845703125 time for calcul the mask position with numpy : 0.008697509765625 nb_pixel_total : 864 time to create 1 rle with old method : 0.0011038780212402344 time for calcul the mask position with numpy : 0.008414030075073242 nb_pixel_total : 309 time to create 1 rle with old method : 0.0003986358642578125 time for calcul the mask position with numpy : 0.008404731750488281 nb_pixel_total : 298 time to create 1 rle with old method : 0.00038313865661621094 time for calcul the mask position with numpy : 0.008435249328613281 nb_pixel_total : 137 time to create 1 rle with old method : 0.00018548965454101562 time for calcul the mask position with numpy : 0.008399724960327148 nb_pixel_total : 156 time to create 1 rle with old method : 0.00026488304138183594 time for calcul the mask position with numpy : 0.008400678634643555 nb_pixel_total : 143 time to create 1 rle with old method : 0.00018358230590820312 time for calcul the mask position with numpy : 0.008369684219360352 nb_pixel_total : 655 time to create 1 rle with old method : 0.0008413791656494141 time for calcul the mask position with numpy : 0.008888721466064453 nb_pixel_total : 663 time to create 1 rle with old method : 0.0008349418640136719 time for calcul the mask position with numpy : 0.00894308090209961 nb_pixel_total : 205 time to create 1 rle with old method : 0.00029778480529785156 time for calcul the mask position with numpy : 0.0088348388671875 nb_pixel_total : 335 time to create 1 rle with old method : 0.00043392181396484375 time for calcul the mask position with numpy : 0.008854389190673828 nb_pixel_total : 983 time to create 1 rle with old method : 0.0011601448059082031 time for calcul the mask position with numpy : 0.008893489837646484 nb_pixel_total : 10 time to create 1 rle with old method : 5.5789947509765625e-05 time for calcul the mask position with numpy : 0.008819818496704102 nb_pixel_total : 530 time to create 1 rle with old method : 0.0006883144378662109 time for calcul the mask position with numpy : 0.00887155532836914 nb_pixel_total : 445 time to create 1 rle with old method : 0.0006074905395507812 time for calcul the mask position with numpy : 0.008890151977539062 nb_pixel_total : 490 time to create 1 rle with old method : 0.0006537437438964844 time for calcul the mask position with numpy : 0.008819580078125 nb_pixel_total : 138 time to create 1 rle with old method : 0.0002455711364746094 time for calcul the mask position with numpy : 0.008638143539428711 nb_pixel_total : 627 time to create 1 rle with old method : 0.0007736682891845703 time for calcul the mask position with numpy : 0.008425235748291016 nb_pixel_total : 953 time to create 1 rle with old method : 0.0011036396026611328 time for calcul the mask position with numpy : 0.008417129516601562 nb_pixel_total : 634 time to create 1 rle with old method : 0.0007638931274414062 time for calcul the mask position with numpy : 0.008388996124267578 nb_pixel_total : 197 time to create 1 rle with old method : 0.0002493858337402344 time for calcul the mask position with numpy : 0.008365869522094727 nb_pixel_total : 343 time to create 1 rle with old method : 0.0004394054412841797 time for calcul the mask position with numpy : 0.008367061614990234 nb_pixel_total : 7 time to create 1 rle with old method : 2.002716064453125e-05 time for calcul the mask position with numpy : 0.008458375930786133 nb_pixel_total : 213 time to create 1 rle with old method : 0.00028967857360839844 time for calcul the mask position with numpy : 0.008492231369018555 nb_pixel_total : 180 time to create 1 rle with old method : 0.00023603439331054688 time for calcul the mask position with numpy : 0.008561372756958008 nb_pixel_total : 229 time to create 1 rle with old method : 0.0003018379211425781 time for calcul the mask position with numpy : 0.010720491409301758 nb_pixel_total : 193 time to create 1 rle with old method : 0.0002803802490234375 time for calcul the mask position with numpy : 0.008933067321777344 nb_pixel_total : 278 time to create 1 rle with old method : 0.00038695335388183594 time for calcul the mask position with numpy : 0.008696794509887695 nb_pixel_total : 151 time to create 1 rle with old method : 0.00019860267639160156 time for calcul the mask position with numpy : 0.008399248123168945 nb_pixel_total : 124 time to create 1 rle with old method : 0.00016832351684570312 time for calcul the mask position with numpy : 0.008390426635742188 nb_pixel_total : 81 time to create 1 rle with old method : 0.00010180473327636719 time for calcul the mask position with numpy : 0.00841379165649414 nb_pixel_total : 41 time to create 1 rle with old method : 0.000217437744140625 create new chi : 1.7840750217437744 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.010033130645751953 batch 1 Loaded 125 chid ids of type : 4230 Number RLEs to save : 11366 TO DO : save crop sub photo not yet done ! save time : 1.09653639793396 nb_obj : 118 nb_hashtags : 5 time to prepare the origin masks : 2.4278008937835693 time for calcul the mask position with numpy : 0.04789447784423828 nb_pixel_total : 1819152 time to create 1 rle with new method : 0.09734845161437988 time for calcul the mask position with numpy : 0.014307022094726562 nb_pixel_total : 144 time to create 1 rle with old method : 0.0002377033233642578 time for calcul the mask position with numpy : 0.013463020324707031 nb_pixel_total : 1872 time to create 1 rle with old method : 0.002727031707763672 time for calcul the mask position with numpy : 0.015532970428466797 nb_pixel_total : 1406 time to create 1 rle with old method : 0.0018172264099121094 time for calcul the mask position with numpy : 0.008233785629272461 nb_pixel_total : 3415 time to create 1 rle with old method : 0.0041272640228271484 time for calcul the mask position with numpy : 0.008849620819091797 nb_pixel_total : 20 time to create 1 rle with old method : 5.9604644775390625e-05 time for calcul the mask position with numpy : 0.008247137069702148 nb_pixel_total : 1254 time to create 1 rle with old method : 0.0015723705291748047 time for calcul the mask position with numpy : 0.008340835571289062 nb_pixel_total : 884 time to create 1 rle with old method : 0.001096487045288086 time for calcul the mask position with numpy : 0.007432699203491211 nb_pixel_total : 51 time to create 1 rle with old method : 0.000118255615234375 time for calcul the mask position with numpy : 0.007524251937866211 nb_pixel_total : 331 time to create 1 rle with old method : 0.0004343986511230469 time for calcul the mask position with numpy : 0.007808208465576172 nb_pixel_total : 383 time to create 1 rle with old method : 0.0004906654357910156 time for calcul the mask position with numpy : 0.007986783981323242 nb_pixel_total : 343 time to create 1 rle with old method : 0.0004515647888183594 time for calcul the mask position with numpy : 0.008110284805297852 nb_pixel_total : 65 time to create 1 rle with old method : 0.0001220703125 time for calcul the mask position with numpy : 0.007899761199951172 nb_pixel_total : 3075 time to create 1 rle with old method : 0.0036764144897460938 time for calcul the mask position with numpy : 0.007582187652587891 nb_pixel_total : 260 time to create 1 rle with old method : 0.0003647804260253906 time for calcul the mask position with numpy : 0.007524967193603516 nb_pixel_total : 51 time to create 1 rle with old method : 0.00011873245239257812 time for calcul the mask position with numpy : 0.008181333541870117 nb_pixel_total : 416 time to create 1 rle with old method : 0.0005662441253662109 time for calcul the mask position with numpy : 0.008087635040283203 nb_pixel_total : 3 time to create 1 rle with old method : 7.104873657226562e-05 time for calcul the mask position with numpy : 0.009691715240478516 nb_pixel_total : 2129 time to create 1 rle with old method : 0.0024912357330322266 time for calcul the mask position with numpy : 0.009375333786010742 nb_pixel_total : 40 time to create 1 rle with old method : 9.584426879882812e-05 time for calcul the mask position with numpy : 0.009211540222167969 nb_pixel_total : 637 time to create 1 rle with old method : 0.0008249282836914062 time for calcul the mask position with numpy : 0.00930166244506836 nb_pixel_total : 1542 time to create 1 rle with old method : 0.001955270767211914 time for calcul the mask position with numpy : 0.009105443954467773 nb_pixel_total : 215 time to create 1 rle with old method : 0.0002987384796142578 time for calcul the mask position with numpy : 0.008184671401977539 nb_pixel_total : 248 time to create 1 rle with old method : 0.00033164024353027344 time for calcul the mask position with numpy : 0.008461236953735352 nb_pixel_total : 905 time to create 1 rle with old method : 0.0012025833129882812 time for calcul the mask position with numpy : 0.008106231689453125 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002651214599609375 time for calcul the mask position with numpy : 0.008225679397583008 nb_pixel_total : 3498 time to create 1 rle with old method : 0.004132747650146484 time for calcul the mask position with numpy : 0.008337974548339844 nb_pixel_total : 4218 time to create 1 rle with old method : 0.0050961971282958984 time for calcul the mask position with numpy : 0.008345365524291992 nb_pixel_total : 8864 time to create 1 rle with old method : 0.010348796844482422 time for calcul the mask position with numpy : 0.012963533401489258 nb_pixel_total : 542 time to create 1 rle with old method : 0.0007290840148925781 time for calcul the mask position with numpy : 0.012619256973266602 nb_pixel_total : 5 time to create 1 rle with old method : 6.508827209472656e-05 time for calcul the mask position with numpy : 0.012760639190673828 nb_pixel_total : 429 time to create 1 rle with old method : 0.0005629062652587891 time for calcul the mask position with numpy : 0.013100385665893555 nb_pixel_total : 737 time to create 1 rle with old method : 0.0009710788726806641 time for calcul the mask position with numpy : 0.012937068939208984 nb_pixel_total : 91 time to create 1 rle with old method : 0.000156402587890625 time for calcul the mask position with numpy : 0.012822389602661133 nb_pixel_total : 1318 time to create 1 rle with old method : 0.0016818046569824219 time for calcul the mask position with numpy : 0.012555837631225586 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006048679351806641 time for calcul the mask position with numpy : 0.012925863265991211 nb_pixel_total : 839 time to create 1 rle with old method : 0.0010173320770263672 time for calcul the mask position with numpy : 0.012435436248779297 nb_pixel_total : 16005 time to create 1 rle with old method : 0.0182647705078125 time for calcul the mask position with numpy : 0.010719060897827148 nb_pixel_total : 450 time to create 1 rle with old method : 0.0005743503570556641 time for calcul the mask position with numpy : 0.00774836540222168 nb_pixel_total : 4 time to create 1 rle with old method : 4.00543212890625e-05 time for calcul the mask position with numpy : 0.007565021514892578 nb_pixel_total : 1345 time to create 1 rle with old method : 0.0016350746154785156 time for calcul the mask position with numpy : 0.007716178894042969 nb_pixel_total : 785 time to create 1 rle with old method : 0.0009739398956298828 time for calcul the mask position with numpy : 0.008204460144042969 nb_pixel_total : 14 time to create 1 rle with old method : 8.296966552734375e-05 time for calcul the mask position with numpy : 0.008253097534179688 nb_pixel_total : 348 time to create 1 rle with old method : 0.0005509853363037109 time for calcul the mask position with numpy : 0.008294105529785156 nb_pixel_total : 9084 time to create 1 rle with old method : 0.010539054870605469 time for calcul the mask position with numpy : 0.008242607116699219 nb_pixel_total : 448 time to create 1 rle with old method : 0.0005831718444824219 time for calcul the mask position with numpy : 0.008569002151489258 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002875328063964844 time for calcul the mask position with numpy : 0.008945703506469727 nb_pixel_total : 797 time to create 1 rle with old method : 0.0013844966888427734 time for calcul the mask position with numpy : 0.010195732116699219 nb_pixel_total : 4040 time to create 1 rle with old method : 0.007111310958862305 time for calcul the mask position with numpy : 0.00973963737487793 nb_pixel_total : 326 time to create 1 rle with old method : 0.0005679130554199219 time for calcul the mask position with numpy : 0.013506650924682617 nb_pixel_total : 4481 time to create 1 rle with old method : 0.010126829147338867 time for calcul the mask position with numpy : 0.007662057876586914 nb_pixel_total : 1637 time to create 1 rle with old method : 0.0020220279693603516 time for calcul the mask position with numpy : 0.008629083633422852 nb_pixel_total : 1571 time to create 1 rle with old method : 0.0019233226776123047 time for calcul the mask position with numpy : 0.007359743118286133 nb_pixel_total : 116 time to create 1 rle with old method : 0.00018143653869628906 time for calcul the mask position with numpy : 0.0074727535247802734 nb_pixel_total : 60 time to create 1 rle with old method : 0.00017261505126953125 time for calcul the mask position with numpy : 0.00959467887878418 nb_pixel_total : 564 time to create 1 rle with old method : 0.0008957386016845703 time for calcul the mask position with numpy : 0.008154869079589844 nb_pixel_total : 41 time to create 1 rle with old method : 0.00010514259338378906 time for calcul the mask position with numpy : 0.008087158203125 nb_pixel_total : 1216 time to create 1 rle with old method : 0.0015256404876708984 time for calcul the mask position with numpy : 0.007864952087402344 nb_pixel_total : 220 time to create 1 rle with old method : 0.00031065940856933594 time for calcul the mask position with numpy : 0.007941722869873047 nb_pixel_total : 553 time to create 1 rle with old method : 0.0006747245788574219 time for calcul the mask position with numpy : 0.007999420166015625 nb_pixel_total : 524 time to create 1 rle with old method : 0.0006799697875976562 time for calcul the mask position with numpy : 0.00793004035949707 nb_pixel_total : 1822 time to create 1 rle with old method : 0.0022013187408447266 time for calcul the mask position with numpy : 0.007863759994506836 nb_pixel_total : 178 time to create 1 rle with old method : 0.0002582073211669922 time for calcul the mask position with numpy : 0.007805347442626953 nb_pixel_total : 129 time to create 1 rle with old method : 0.00020694732666015625 time for calcul the mask position with numpy : 0.00783085823059082 nb_pixel_total : 99 time to create 1 rle with old method : 0.000171661376953125 time for calcul the mask position with numpy : 0.007635354995727539 nb_pixel_total : 490 time to create 1 rle with old method : 0.0006315708160400391 time for calcul the mask position with numpy : 0.008701801300048828 nb_pixel_total : 106479 time to create 1 rle with old method : 0.12377262115478516 time for calcul the mask position with numpy : 0.007593393325805664 nb_pixel_total : 182 time to create 1 rle with old method : 0.00025653839111328125 time for calcul the mask position with numpy : 0.007654666900634766 nb_pixel_total : 167 time to create 1 rle with old method : 0.00024509429931640625 time for calcul the mask position with numpy : 0.007880449295043945 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002970695495605469 time for calcul the mask position with numpy : 0.007916688919067383 nb_pixel_total : 167 time to create 1 rle with old method : 0.00027871131896972656 time for calcul the mask position with numpy : 0.007866382598876953 nb_pixel_total : 271 time to create 1 rle with old method : 0.0003681182861328125 time for calcul the mask position with numpy : 0.007944107055664062 nb_pixel_total : 201 time to create 1 rle with old method : 0.0002837181091308594 time for calcul the mask position with numpy : 0.00816488265991211 nb_pixel_total : 852 time to create 1 rle with old method : 0.0010819435119628906 time for calcul the mask position with numpy : 0.008843183517456055 nb_pixel_total : 38846 time to create 1 rle with old method : 0.04422760009765625 time for calcul the mask position with numpy : 0.007701396942138672 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002651214599609375 time for calcul the mask position with numpy : 0.00762486457824707 nb_pixel_total : 463 time to create 1 rle with old method : 0.0005991458892822266 time for calcul the mask position with numpy : 0.007619380950927734 nb_pixel_total : 713 time to create 1 rle with old method : 0.0009615421295166016 time for calcul the mask position with numpy : 0.007607698440551758 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005571842193603516 time for calcul the mask position with numpy : 0.007661581039428711 nb_pixel_total : 352 time to create 1 rle with old method : 0.00047969818115234375 time for calcul the mask position with numpy : 0.00789642333984375 nb_pixel_total : 697 time to create 1 rle with old method : 0.0008654594421386719 time for calcul the mask position with numpy : 0.0076711177825927734 nb_pixel_total : 344 time to create 1 rle with old method : 0.00047469139099121094 time for calcul the mask position with numpy : 0.008437871932983398 nb_pixel_total : 265 time to create 1 rle with old method : 0.0003573894500732422 time for calcul the mask position with numpy : 0.00840616226196289 nb_pixel_total : 121 time to create 1 rle with old method : 0.0001938343048095703 time for calcul the mask position with numpy : 0.007729768753051758 nb_pixel_total : 64 time to create 1 rle with old method : 0.0001220703125 time for calcul the mask position with numpy : 0.007710456848144531 nb_pixel_total : 220 time to create 1 rle with old method : 0.00030541419982910156 time for calcul the mask position with numpy : 0.008244752883911133 nb_pixel_total : 598 time to create 1 rle with old method : 0.001102447509765625 time for calcul the mask position with numpy : 0.008377552032470703 nb_pixel_total : 1074 time to create 1 rle with old method : 0.0018732547760009766 time for calcul the mask position with numpy : 0.007898092269897461 nb_pixel_total : 174 time to create 1 rle with old method : 0.00034499168395996094 time for calcul the mask position with numpy : 0.007885456085205078 nb_pixel_total : 170 time to create 1 rle with old method : 0.00033402442932128906 time for calcul the mask position with numpy : 0.007895469665527344 nb_pixel_total : 1498 time to create 1 rle with old method : 0.0025539398193359375 time for calcul the mask position with numpy : 0.007945775985717773 nb_pixel_total : 210 time to create 1 rle with old method : 0.00039505958557128906 time for calcul the mask position with numpy : 0.007978677749633789 nb_pixel_total : 727 time to create 1 rle with old method : 0.0012731552124023438 time for calcul the mask position with numpy : 0.007947683334350586 nb_pixel_total : 1522 time to create 1 rle with old method : 0.002562999725341797 time for calcul the mask position with numpy : 0.007817506790161133 nb_pixel_total : 451 time to create 1 rle with old method : 0.0005691051483154297 time for calcul the mask position with numpy : 0.007652997970581055 nb_pixel_total : 2 time to create 1 rle with old method : 5.340576171875e-05 time for calcul the mask position with numpy : 0.007735013961791992 nb_pixel_total : 150 time to create 1 rle with old method : 0.00022482872009277344 time for calcul the mask position with numpy : 0.008417606353759766 nb_pixel_total : 168 time to create 1 rle with old method : 0.0002467632293701172 time for calcul the mask position with numpy : 0.007673978805541992 nb_pixel_total : 1071 time to create 1 rle with old method : 0.001299142837524414 time for calcul the mask position with numpy : 0.00779414176940918 nb_pixel_total : 154 time to create 1 rle with old method : 0.0003726482391357422 time for calcul the mask position with numpy : 0.011953592300415039 nb_pixel_total : 199 time to create 1 rle with old method : 0.0002808570861816406 time for calcul the mask position with numpy : 0.007782697677612305 nb_pixel_total : 57 time to create 1 rle with old method : 0.0001423358917236328 time for calcul the mask position with numpy : 0.007892131805419922 nb_pixel_total : 575 time to create 1 rle with old method : 0.0007276535034179688 time for calcul the mask position with numpy : 0.00827932357788086 nb_pixel_total : 846 time to create 1 rle with old method : 0.0010509490966796875 time for calcul the mask position with numpy : 0.00829005241394043 nb_pixel_total : 434 time to create 1 rle with old method : 0.0005517005920410156 time for calcul the mask position with numpy : 0.0077724456787109375 nb_pixel_total : 497 time to create 1 rle with old method : 0.0005974769592285156 time for calcul the mask position with numpy : 0.007842302322387695 nb_pixel_total : 165 time to create 1 rle with old method : 0.00022792816162109375 time for calcul the mask position with numpy : 0.008314371109008789 nb_pixel_total : 149 time to create 1 rle with old method : 0.00022721290588378906 time for calcul the mask position with numpy : 0.008295297622680664 nb_pixel_total : 932 time to create 1 rle with old method : 0.0010995864868164062 time for calcul the mask position with numpy : 0.008304357528686523 nb_pixel_total : 598 time to create 1 rle with old method : 0.0007607936859130859 time for calcul the mask position with numpy : 0.008583784103393555 nb_pixel_total : 658 time to create 1 rle with old method : 0.0008192062377929688 time for calcul the mask position with numpy : 0.008408308029174805 nb_pixel_total : 194 time to create 1 rle with old method : 0.0002753734588623047 time for calcul the mask position with numpy : 0.008259773254394531 nb_pixel_total : 200 time to create 1 rle with old method : 0.0002846717834472656 time for calcul the mask position with numpy : 0.00816798210144043 nb_pixel_total : 613 time to create 1 rle with old method : 0.0007488727569580078 time for calcul the mask position with numpy : 0.00840449333190918 nb_pixel_total : 155 time to create 1 rle with old method : 0.000225067138671875 time for calcul the mask position with numpy : 0.008350372314453125 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003714561462402344 time for calcul the mask position with numpy : 0.008808374404907227 nb_pixel_total : 172 time to create 1 rle with old method : 0.0002474784851074219 time for calcul the mask position with numpy : 0.008781671524047852 nb_pixel_total : 95 time to create 1 rle with old method : 0.00016617774963378906 time for calcul the mask position with numpy : 0.008921384811401367 nb_pixel_total : 76 time to create 1 rle with old method : 0.00014472007751464844 create new chi : 1.500734567642212 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0022821426391601562 batch 1 Loaded 119 chid ids of type : 4230 Number RLEs to save : 11383 TO DO : save crop sub photo not yet done ! save time : 0.9228501319885254 map_output_result : {1334205130: (0.0, 'Should be the crop_list due to order', 0.0), 1334205125: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1334205130, 1334205125] Looping around the photos to save general results len do output : 2 /1334205130.Didn't retrieve data . /1334205125.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2542836') ('4234', '20196734', '1334205130', None, None, None, None, None, '2542836') ('4234', None, None, None, None, None, None, None, '2542836') ('4234', '20196734', '1334205125', None, None, None, None, None, '2542836') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.017037153244018555 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.412397623062134 time spend to save output : 0.017571210861206055 total time spend for step 4 : 9.42996883392334 step5:crop_condition Tue Feb 4 06:21:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 2 ! batch 1 Loaded 244 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 86 About to insert : list_path_to_insert length 86 new photo from crops ! About to upload 86 photos upload in portfolio : 4869462 init cache_photo without model_param we have 86 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738646468_2825438 we have uploaded 86 photos in the portfolio 4869462 time of upload the photos Elapsed time : 23.97422218322754 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 4869462 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738646492_2825438 we have uploaded 29 photos in the portfolio 4869462 time of upload the photos Elapsed time : 6.825591325759888 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 4869462 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738646499_2825438 we have uploaded 16 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.6345138549804688 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 4869462 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738646504_2825438 we have uploaded 24 photos in the portfolio 4869462 time of upload the photos Elapsed time : 5.70355224609375 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1334205130, 1334205125] Looping around the photos to save general results len do output : 155 /1334453670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334453998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1334454025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2542836') ('4234', '20196734', '1334205130', None, None, None, None, None, '2542836') ('4234', None, None, None, None, None, None, None, '2542836') ('4234', '20196734', '1334205125', None, None, None, None, None, '2542836') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 467 time used for this insertion : 0.036031246185302734 save_final save missing photos in datou_result : time spend for datou_step_exec : 44.12317419052124 time spend to save output : 0.5205013751983643 total time spend for step 5 : 44.643675565719604 step6:thcl Tue Feb 4 06:21:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.0073544979095458984 time to convert the images to numpy array : 0.032669782638549805 time to import caffe and check if the image exist : 0.014798164367675781 time to convert the images to numpy array : 0.048053741455078125 time to import caffe and check if the image exist : 0.01121211051940918 time to convert the images to numpy array : 0.056040287017822266 time to import caffe and check if the image exist : 0.019684791564941406 time to convert the images to numpy array : 0.04862356185913086 time to import caffe and check if the image exist : 0.013950824737548828 time to convert the images to numpy array : 0.056459665298461914 time to import caffe and check if the image exist : 0.01783895492553711 time to convert the images to numpy array : 0.053878068923950195 time to import caffe and check if the image exist : 0.02736496925354004 time to convert the images to numpy array : 0.04532957077026367 time to import caffe and check if the image exist : 0.01823592185974121 time to convert the images to numpy array : 0.055463552474975586 time to import caffe and check if the image exist : 0.025914907455444336 time to convert the images to numpy array : 0.048950910568237305 time to import caffe and check if the image exist : 0.020261764526367188 time to convert the images to numpy array : 0.0563967227935791 total time to convert the images to numpy array : 0.5454273223876953 list photo_ids error: [] list photo_ids correct : [1334454015, 1334454016, 1334454017, 1334454018, 1334454019, 1334454020, 1334454021, 1334454022, 1334454023, 1334454024, 1334454025, 1334453670, 1334453671, 1334453672, 1334453673, 1334453674, 1334453675, 1334453676, 1334453677, 1334453678, 1334453679, 1334453681, 1334453684, 1334453687, 1334453690, 1334453693, 1334453696, 1334453887, 1334453890, 1334453893, 1334453896, 1334453900, 1334453903, 1334453940, 1334453941, 1334453942, 1334453944, 1334453945, 1334453946, 1334453947, 1334453948, 1334453949, 1334453950, 1334453996, 1334453997, 1334453998, 1334454001, 1334454002, 1334454004, 1334454005, 1334454006, 1334454007, 1334454008, 1334454009, 1334454010, 1334454011, 1334454012, 1334454013, 1334454014, 1334453967, 1334453968, 1334453969, 1334453982, 1334453983, 1334453984, 1334453986, 1334453987, 1334453988, 1334453989, 1334453990, 1334453991, 1334453992, 1334453993, 1334453994, 1334453995, 1334453792, 1334453795, 1334453797, 1334453800, 1334453803, 1334453806, 1334453809, 1334453811, 1334453814, 1334453817, 1334453821, 1334453824, 1334453827, 1334453830, 1334453833, 1334453836, 1334453699, 1334453702, 1334453705, 1334453709, 1334453712, 1334453715, 1334453718, 1334453721, 1334453724, 1334453726, 1334453729, 1334453732, 1334453735, 1334453738, 1334453742, 1334453745, 1334453951, 1334453952, 1334453953, 1334453954, 1334453955, 1334453956, 1334453957, 1334453958, 1334453959, 1334453960, 1334453961, 1334453962, 1334453963, 1334453964, 1334453965, 1334453966, 1334453840, 1334453843, 1334453846, 1334453849, 1334453852, 1334453855, 1334453858, 1334453861, 1334453864, 1334453867, 1334453869, 1334453872, 1334453874, 1334453877, 1334453880, 1334453883, 1334453748, 1334453750, 1334453753, 1334453757, 1334453760, 1334453762, 1334453764, 1334453766, 1334453769, 1334453772, 1334453775, 1334453778, 1334453780, 1334453783, 1334453786, 1334453789] number of photos to traite : 155 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2745 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2526 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 0.7767925262451172 time used to do the prediction : 0.8640379905700684 save descriptor for thcl : 3237 time to traite the descriptors : 0.9524691104888916 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1334454015 To insert : 1334454016 To insert : 1334454017 To insert : 1334454018 To insert : 1334454019 To insert : 1334454020 To insert : 1334454021 To insert : 1334454022 To insert : 1334454023 To insert : 1334454024 To insert : 1334454025 To insert : 1334453670 To insert : 1334453671 To insert : 1334453672 To insert : 1334453673 To insert : 1334453674 To insert : 1334453675 To insert : 1334453676 To insert : 1334453677 To insert : 1334453678 To insert : 1334453679 To insert : 1334453681 To insert : 1334453684 To insert : 1334453687 To insert : 1334453690 To insert : 1334453693 To insert : 1334453696 To insert : 1334453887 To insert : 1334453890 To insert : 1334453893 To insert : 1334453896 To insert : 1334453900 To insert : 1334453903 To insert : 1334453940 To insert : 1334453941 To insert : 1334453942 To insert : 1334453944 To insert : 1334453945 To insert : 1334453946 To insert : 1334453947 To insert : 1334453948 To insert : 1334453949 To insert : 1334453950 To insert : 1334453996 To insert : 1334453997 To insert : 1334453998 To insert : 1334454001 To insert : 1334454002 To insert : 1334454004 To insert : 1334454005 To insert : 1334454006 To insert : 1334454007 To insert : 1334454008 To insert : 1334454009 To insert : 1334454010 To insert : 1334454011 To insert : 1334454012 To insert : 1334454013 To insert : 1334454014 To insert : 1334453967 To insert : 1334453968 To insert : 1334453969 To insert : 1334453982 To insert : 1334453983 To insert : 1334453984 To insert : 1334453986 To insert : 1334453987 To insert : 1334453988 To insert : 1334453989 To insert : 1334453990 To insert : 1334453991 To insert : 1334453992 To insert : 1334453993 To insert : 1334453994 To insert : 1334453995 To insert : 1334453792 To insert : 1334453795 To insert : 1334453797 To insert : 1334453800 To insert : 1334453803 To insert : 1334453806 To insert : 1334453809 To insert : 1334453811 To insert : 1334453814 To insert : 1334453817 To insert : 1334453821 To insert : 1334453824 To insert : 1334453827 To insert : 1334453830 To insert : 1334453833 To insert : 1334453836 To insert : 1334453699 To insert : 1334453702 To insert : 1334453705 To insert : 1334453709 To insert : 1334453712 To insert : 1334453715 To insert : 1334453718 To insert : 1334453721 To insert : 1334453724 To insert : 1334453726 To insert : 1334453729 To insert : 1334453732 To insert : 1334453735 To insert : 1334453738 To insert : 1334453742 To insert : 1334453745 To insert : 1334453951 To insert : 1334453952 To insert : 1334453953 To insert : 1334453954 To insert : 1334453955 To insert : 1334453956 To insert : 1334453957 To insert : 1334453958 To insert : 1334453959 To insert : 1334453960 To insert : 1334453961 To insert : 1334453962 To insert : 1334453963 To insert : 1334453964 To insert : 1334453965 To insert : 1334453966 To insert : 1334453840 To insert : 1334453843 To insert : 1334453846 To insert : 1334453849 To insert : 1334453852 To insert : 1334453855 To insert : 1334453858 To insert : 1334453861 To insert : 1334453864 To insert : 1334453867 To insert : 1334453869 To insert : 1334453872 To insert : 1334453874 To insert : 1334453877 To insert : 1334453880 To insert : 1334453883 To insert : 1334453748 To insert : 1334453750 To insert : 1334453753 To insert : 1334453757 To insert : 1334453760 To insert : 1334453762 To insert : 1334453764 To insert : 1334453766 To insert : 1334453769 To insert : 1334453772 To insert : 1334453775 To insert : 1334453778 To insert : 1334453780 To insert : 1334453783 To insert : 1334453786 To insert : 1334453789 time to insert the descriptors : 27.988252639770508 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 229 time used for this insertion : 0.022278785705566406 save missing photos in datou_result : time spend for datou_step_exec : 35.67788743972778 time spend to save output : 0.09555673599243164 total time spend for step 6 : 35.773444175720215 step7:ventilate_hashtags_in_portfolio Tue Feb 4 06:22:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20196734 get user id for portfolio 20196734 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196734 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('Papier','mal_croppe','metal','pehd','autre','environnement','refus','flou','Carton','pet_fonce','PET_fonce','carton','papier','PEHD','Tetrapak','pet_clair','Film_plastique','PET_clair')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196734 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('Papier','mal_croppe','metal','pehd','autre','environnement','refus','flou','Carton','pet_fonce','PET_fonce','carton','papier','PEHD','Tetrapak','pet_clair','Film_plastique','PET_clair')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196734 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('Papier','mal_croppe','metal','pehd','autre','environnement','refus','flou','Carton','pet_fonce','PET_fonce','carton','papier','PEHD','Tetrapak','pet_clair','Film_plastique','PET_clair')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196734 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('Papier','mal_croppe','metal','pehd','autre','environnement','refus','flou','Carton','pet_fonce','PET_fonce','carton','papier','PEHD','Tetrapak','pet_clair','Film_plastique','PET_clair')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20199317,20199306,20199307,20199318,20199309,20199310,20199311,20199312,20199316,20199315,20199319,20199322,20199321?tags=papier,mal_croppe,metal,pehd,autre,environnement,refus,flou,carton,pet_fonce,tetrapak,pet_clair,film_plastique&datou_id_consolidate=4235&port_consolidate=20196734 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1334205130, 1334205125] Looping around the photos to save general results len do output : 1 /20196734. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2542836') ('4234', '20196734', '1334205130', None, None, None, None, None, '2542836') ('4234', None, None, None, None, None, None, None, '2542836') ('4234', '20196734', '1334205125', None, None, None, None, None, '2542836') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.013414859771728516 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.082897186279297 time spend to save output : 0.014249086380004883 total time spend for step 7 : 3.0971462726593018 step8:final Tue Feb 4 06:22:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1334205130: ('0.17055652470993976',), 1334205125: ('0.17055652470993976',)} new output for save of step final : {1334205130: ('0.17055652470993976',), 1334205125: ('0.17055652470993976',)} [1334205130, 1334205125] Looping around the photos to save general results len do output : 2 /1334205130.Didn't retrieve data . /1334205125.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2542836') ('4234', '20196734', '1334205130', None, None, None, None, None, '2542836') ('4234', None, None, None, None, None, None, None, '2542836') ('4234', '20196734', '1334205125', None, None, None, None, None, '2542836') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012380599975585938 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11884236335754395 time spend to save output : 0.01280522346496582 total time spend for step 8 : 0.13164758682250977 step9:velours_tree Tue Feb 4 06:22:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20199317,20199306,20199307,20199318,20199309,20199310,20199311,20199312,20199316,20199315,20199319,20199322,20199321 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20199317 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20199306 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20199307 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20199318 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20199309 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20199310 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20199311 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20199312 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20199316 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20199315 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20199319 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20199322 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20199321 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 155 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [5 0 0 5 1 4 2 2 2 1 1 2 2 2 3 2 3 2 1 0 1 2 1 0 2 2 0 0 2 4 0 0 2 1 1 0 1 1 4 4 2 2 4 2 0 0 1 4 5 4 0 1 1 2 2 1 1 2 2 2 2 3 2 3 1 1 0 2 1 2 2 0 2 4 1 0 1 1 0 4 0 4 4 2 2 2 1 3 1 0 1 0 2 0 1 0 2 2 1 2 0 3 1 1 0 1 1 0 2 0 0 2 2 2 4 4 3 2 3 0 4 4 2 3 2 3 0 4 0 2 4 0 0 1 0 0 0 0 1 2 0 0 0 1 0 4 0 5 2 0 1 0 0 0 0] Elapsed time: 0.02599024772644043 graph_id used : 75896 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20199317,20199306,20199307,20199318,20199309,20199310,20199311,20199312,20199316,20199315,20199319,20199322,20199321?tags=papier,mal_croppe,metal,pehd,autre,environnement,refus,flou,carton,pet_fonce,tetrapak,pet_clair,film_plastique&datou_id_consolidate=4235&port_consolidate=20196734&tree_id=75896 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1334205130, 1334205125] Looping around the photos to save general results len do output : 1 /20196734Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2542836') ('4234', '20196734', '1334205130', None, None, None, None, None, '2542836') ('4234', None, None, None, None, None, None, None, '2542836') ('4234', '20196734', '1334205125', None, None, None, None, None, '2542836') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.01253366470336914 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.245462894439697 time spend to save output : 0.012922286987304688 total time spend for step 9 : 11.258385181427002 step10:send_mail_cod Tue Feb 4 06:22:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20196734_04-02-2025_06_22_41.pdf 20199299 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201992991738646561 20199288 imagette201992881738646562 20199289 imagette201992891738646562 20199300 imagette201993001738646562 20199291 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201992911738646562 20199293 imagette201992931738646563 20199294 imagette201992941738646563 20199298 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201992981738646563 20199297 imagette201992971738646564 20199301 imagette201993011738646564 20199304 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201993041738646564 20199303 imagette201993031738646565 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20196734 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20199317,20199306,20199307,20199318,20199309,20199310,20199311,20199312,20199316,20199315,20199319,20199322,20199321?tags=papier,mal_croppe,metal,pehd,autre,environnement,refus,flou,carton,pet_fonce,tetrapak,pet_clair,film_plastique&datou_id_consolidate=4235&port_consolidate=20196734&tree_id=75896 your option no_mail is active, we will not send the real mail to your client args[1334205130] : ((1334205130, -8.023341782334327, 492609224), (1334205130, -0.3489323899728193, 496442774), '0.17055652470993976') We are sending mail with results at cod@fotonower.com args[1334205125] : ((1334205125, -8.02020809744936, 492609224), (1334205125, -0.34757997271761515, 496442774), '0.17055652470993976') We are sending mail with results at cod@fotonower.com refus_total : 0.17055652470993976 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20196734 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196734_04-02-2025_06_22_41.pdf results_Qualipapia_P20196734_04-02-2025_06_22_41.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196734_04-02-2025_06_22_41.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20196734','results_Qualipapia_P20196734_04-02-2025_06_22_41.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196734_04-02-2025_06_22_41.pdf','pdf','','0.15','0.17055652470993976') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1334205130, 1334205125] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2542836') ('4234', '20196734', '1334205130', None, None, None, None, None, '2542836') ('4234', None, None, None, None, None, None, None, '2542836') ('4234', '20196734', '1334205125', None, None, None, None, None, '2542836') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.015244483947753906 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.039846658706665 time spend to save output : 0.015481948852539062 total time spend for step 10 : 6.055328607559204 step11:split_time_score Tue Feb 4 06:22:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 2),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 03022025 20196734 Nombre de photos uploadées : 2 / 23040 (0%) 03022025 20196734 Nombre de photos taguées (types de déchets): 2 / 2 (100%) 03022025 20196734 Nombre de photos taguées (volume) : 0 / 2 (0%) elapsed_time : load_data_split_time_score 4.0531158447265625e-06 elapsed_time : order_list_meta_photo_and_scores 1.2636184692382812e-05 ?? elapsed_time : fill_and_build_computed_from_old_data 0.00024008750915527344 elapsed_time : insert_dashboard_record_day_entry 0.029559612274169922 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20176367 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20176369 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20176371 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20176372 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20176373 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177132 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177536 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177537 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177538 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177540 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177542 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177544 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177136 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177137 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177139 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177141 order by id desc limit 1 Qualite : 0.21292892814622896 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20177143_03-02-2025_13_38_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177143 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20177143 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177145 order by id desc limit 1 Qualite : 0.2424867140556751 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20177147_03-02-2025_13_17_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177147 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20177147 AND mptpi.`type`=4230 To do Qualite : 0.19451837294234825 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20177148_03-02-2025_13_22_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177148 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20177148 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177546 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177548 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196659 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196660 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196661 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178445 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178447 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178449 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177550 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177551 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177552 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177553 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177554 order by id desc limit 1 Qualite : 0.2145365304915854 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20177555_03-02-2025_13_50_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20177555 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20177555 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178451 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178453 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178454 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178455 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178456 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178457 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178458 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178459 order by id desc limit 1 Qualite : 0.2040980434753746 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20178460_03-02-2025_15_34_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178460 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20178460 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178461 order by id desc limit 1 Qualite : 0.18915657544982803 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20178463_03-02-2025_15_49_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178463 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20178463 AND mptpi.`type`=4230 To do Qualite : 0.1316372178669276 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20178464_03-02-2025_14_18_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20178464 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20178464 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196674 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196675 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196676 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196677 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196678 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196679 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196680 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196681 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196682 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196683 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196684 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196685 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196686 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196687 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196688 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196689 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196690 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196691 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196692 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196693 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196694 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196695 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196696 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196697 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196698 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196699 order by id desc limit 1 Qualite : 0.17055652470993976 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196734_04-02-2025_06_22_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196734 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196734 AND mptpi.`type`=4230 To do Qualite : 0.18007752169747065 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196753_04-02-2025_05_51_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196753 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196753 AND mptpi.`type`=4230 To do Qualite : 0.1814949089633484 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196754_04-02-2025_04_51_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196754 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196754 AND mptpi.`type`=4230 To do Qualite : 0.18082866271416992 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196755_04-02-2025_05_37_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196755 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196755 AND mptpi.`type`=4230 To do Qualite : 0.2017179168439782 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196756_04-02-2025_05_26_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196756 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196756 AND mptpi.`type`=4230 To do Qualite : 0.18374180424076644 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196757_04-02-2025_03_57_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196757 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196757 AND mptpi.`type`=4230 To do Qualite : 0.16673114822214968 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196758_04-02-2025_04_05_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196758 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196758 AND mptpi.`type`=4230 To do Qualite : 0.15347875164298508 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196759_04-02-2025_03_34_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196759 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196759 AND mptpi.`type`=4230 To do Qualite : 0.14799233120100228 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196760_04-02-2025_03_34_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196760 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196760 AND mptpi.`type`=4230 To do Qualite : 0.1633757293295666 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196761_04-02-2025_03_12_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196761 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196761 AND mptpi.`type`=4230 To do Qualite : 0.15382133591622987 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196762_04-02-2025_03_18_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196762 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196762 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182947 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182948 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182949 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182950 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182951 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182952 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182953 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182954 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182955 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182956 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182957 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182958 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182959 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182960 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182961 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182962 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182963 order by id desc limit 1 Qualite : 0.17741188572002212 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20182964_03-02-2025_16_42_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182964 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20182964 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182965 order by id desc limit 1 Qualite : 0.17337574359014693 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20182966_03-02-2025_16_51_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20182966 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20182966 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195963 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195982 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196001 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196002 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196003 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196004 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196005 order by id desc limit 1 Qualite : 0.22031956872303599 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196006_04-02-2025_02_55_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196006 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196006 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196007 order by id desc limit 1 Qualite : 0.2081495019131404 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196008_04-02-2025_02_19_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196008 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196008 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196009 order by id desc limit 1 Qualite : 0.17369673605767658 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196010_04-02-2025_02_43_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196010 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196010 AND mptpi.`type`=4230 To do Qualite : 0.19649604863611195 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20196011_04-02-2025_02_26_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20196011 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20196011 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195286 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195287 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195288 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195289 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195290 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195291 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195292 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195293 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195294 order by id desc limit 1 Qualite : 0.2590217849133118 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20195295_04-02-2025_02_13_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195295 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20195295 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195296 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195297 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20185147 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20185148 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20185149 order by id desc limit 1 Qualite : 0.19514078321323755 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20185150_03-02-2025_17_56_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20185150 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20185150 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20185151 order by id desc limit 1 Qualite : 0.2109236656958151 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20185152_03-02-2025_17_34_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20185152 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20185152 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20185153 order by id desc limit 1 Qualite : 0.2058590485936177 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20195298_04-02-2025_01_33_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195298 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20195298 AND mptpi.`type`=4230 To do Qualite : 0.16358385040964132 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20195299_04-02-2025_01_20_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195299 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20195299 AND mptpi.`type`=4230 To do Qualite : 0.16237848895335452 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20195300_04-02-2025_01_12_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20195300 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20195300 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187883 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187885 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187886 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187906 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187925 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187927 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187928 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187930 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187931 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187957 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187958 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187960 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187961 order by id desc limit 1 Qualite : 0.22976580988085368 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20187963_03-02-2025_21_52_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187963 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20187963 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187237 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187239 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187241 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187242 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187243 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187244 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187245 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187246 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187248 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187249 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187250 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187251 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187252 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187253 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187254 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187255 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187256 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187257 order by id desc limit 1 Qualite : 0.19365526838404737 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20187258_03-02-2025_18_41_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187258 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20187258 AND mptpi.`type`=4230 To do Qualite : 0.19095206134394982 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20187964_03-02-2025_19_33_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187964 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20187964 AND mptpi.`type`=4230 To do Qualite : 0.19225791186413807 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20187966_03-02-2025_18_56_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187966 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20187966 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187261 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187262 order by id desc limit 1 Qualite : 0.18675850133235133 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20187263_03-02-2025_18_23_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20187263 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20187263 AND mptpi.`type`=4230 To do Qualite : 0.2120167913685455 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20194589_04-02-2025_00_32_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20194589 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20194589 AND mptpi.`type`=4230 To do Qualite : 0.2088999932101745 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20190513_03-02-2025_20_33_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20190513 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20190513 AND mptpi.`type`=4230 To do Qualite : 0.18671028645624485 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20190539_03-02-2025_21_38_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20190539 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20190539 AND mptpi.`type`=4230 To do Qualite : 0.17408052439626492 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20190542_03-02-2025_19_48_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20190542 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20190542 AND mptpi.`type`=4230 To do Qualite : 0.20425164642167953 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20194590_04-02-2025_00_11_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20194590 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20194590 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'03022025': {'nb_upload': 2, 'nb_taggue_class': 2, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1334205130, 1334205125] Looping around the photos to save general results len do output : 1 /20196734Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2542836') ('4234', '20196734', '1334205130', None, None, None, None, None, '2542836') ('4234', None, None, None, None, None, None, None, '2542836') ('4234', '20196734', '1334205125', None, None, None, None, None, '2542836') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.0180361270904541 save_final save missing photos in datou_result : time spend for datou_step_exec : 114.31917190551758 time spend to save output : 0.022766590118408203 total time spend for step 11 : 114.34193849563599 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 2 set_done_treatment 35.46user 23.69system 4:18.72elapsed 22%CPU (0avgtext+0avgdata 2431112maxresident)k 909920inputs+11904outputs (14089major+2309843minor)pagefaults 0swaps