python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 501992 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2588613'] with mtr_portfolio_ids : ['20567470'] and first list_photo_ids : [] new path : /proc/501992/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 2 ; length of list_pids : 2 ; length of list_args : 2 time to download the photos : 0.3267219066619873 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Sat Feb 15 10:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-15 10:20:32.224333: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-15 10:20:32.251070: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-15 10:20:32.253147: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f8084000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-15 10:20:32.253202: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-15 10:20:32.257088: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-15 10:20:32.393038: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x22c14810 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-15 10:20:32.393086: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-15 10:20:32.394523: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-15 10:20:32.394942: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-15 10:20:32.397924: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-15 10:20:32.400920: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-15 10:20:32.401392: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-15 10:20:32.404374: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-15 10:20:32.405370: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-15 10:20:32.409475: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-15 10:20:32.410920: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-15 10:20:32.410993: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-15 10:20:32.411794: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-15 10:20:32.411810: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-15 10:20:32.411819: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-15 10:20:32.413086: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9819 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-15 10:20:32.679211: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-15 10:20:32.679338: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-15 10:20:32.679370: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-15 10:20:32.679396: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-15 10:20:32.679425: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-15 10:20:32.679454: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-15 10:20:32.679481: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-15 10:20:32.679503: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-15 10:20:32.681375: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-15 10:20:32.682887: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-15 10:20:32.683014: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-15 10:20:32.683041: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-15 10:20:32.683061: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-15 10:20:32.683088: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-15 10:20:32.683119: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-15 10:20:32.683141: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-15 10:20:32.683162: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-15 10:20:32.684758: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-15 10:20:32.684795: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-15 10:20:32.684809: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-15 10:20:32.684818: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-15 10:20:32.686286: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9819 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-15 10:20:40.407101: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-15 10:20:40.603692: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 2 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.62188 max: 148.82656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 0.000102996826171875 nb_pixel_total : 868 time to create 1 rle with old method : 0.0017404556274414062 length of segment : 34 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 81 time to create 1 rle with old method : 0.00019216537475585938 length of segment : 29 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 18 time to create 1 rle with old method : 0.0001201629638671875 length of segment : 1 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.00020051002502441406 length of segment : 28 time for calcul the mask position with numpy : 0.0003581047058105469 nb_pixel_total : 2419 time to create 1 rle with old method : 0.005110263824462891 length of segment : 91 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.0002048015594482422 length of segment : 35 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 565 time to create 1 rle with old method : 0.0008847713470458984 length of segment : 25 time for calcul the mask position with numpy : 8.440017700195312e-05 nb_pixel_total : 1480 time to create 1 rle with old method : 0.0020918846130371094 length of segment : 60 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 719 time to create 1 rle with old method : 0.0010824203491210938 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.95781 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002732276916503906 length of segment : 13 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1357 time to create 1 rle with old method : 0.0026612281799316406 length of segment : 32 time for calcul the mask position with numpy : 0.00010800361633300781 nb_pixel_total : 2127 time to create 1 rle with old method : 0.0038902759552001953 length of segment : 46 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0005626678466796875 length of segment : 41 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 805 time to create 1 rle with old method : 0.0016908645629882812 length of segment : 51 time for calcul the mask position with numpy : 8.654594421386719e-05 nb_pixel_total : 1193 time to create 1 rle with old method : 0.002312898635864258 length of segment : 93 time for calcul the mask position with numpy : 9.894371032714844e-05 nb_pixel_total : 980 time to create 1 rle with old method : 0.0020456314086914062 length of segment : 114 time for calcul the mask position with numpy : 8.7738037109375e-05 nb_pixel_total : 1626 time to create 1 rle with old method : 0.0023984909057617188 length of segment : 72 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 61 time to create 1 rle with old method : 0.0001633167266845703 length of segment : 8 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 498 time to create 1 rle with old method : 0.0006911754608154297 length of segment : 31 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 788 time to create 1 rle with old method : 0.0011777877807617188 length of segment : 40 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.0002288818359375 length of segment : 9 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 521 time to create 1 rle with old method : 0.0008664131164550781 length of segment : 39 time for calcul the mask position with numpy : 9.274482727050781e-05 nb_pixel_total : 1534 time to create 1 rle with old method : 0.0021347999572753906 length of segment : 50 time for calcul the mask position with numpy : 8.7738037109375e-05 nb_pixel_total : 1121 time to create 1 rle with old method : 0.0015769004821777344 length of segment : 47 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 848 time to create 1 rle with old method : 0.0012879371643066406 length of segment : 51 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 1535 time to create 1 rle with old method : 0.001997709274291992 length of segment : 50 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.20000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00013113021850585938 nb_pixel_total : 6591 time to create 1 rle with old method : 0.015256404876708984 length of segment : 121 time for calcul the mask position with numpy : 9.083747863769531e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.0007507801055908203 length of segment : 12 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.00021266937255859375 length of segment : 10 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.30547 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.000446319580078125 length of segment : 17 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 998 time to create 1 rle with old method : 0.0011827945709228516 length of segment : 52 time for calcul the mask position with numpy : 0.0001595020294189453 nb_pixel_total : 8121 time to create 1 rle with old method : 0.00937652587890625 length of segment : 138 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.00030684471130371094 length of segment : 19 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0006833076477050781 length of segment : 26 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.00024962425231933594 length of segment : 11 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 402 time to create 1 rle with old method : 0.0006296634674072266 length of segment : 24 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.37344 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 9.107589721679688e-05 nb_pixel_total : 3145 time to create 1 rle with old method : 0.005557060241699219 length of segment : 86 time for calcul the mask position with numpy : 9.751319885253906e-05 nb_pixel_total : 1326 time to create 1 rle with old method : 0.001519918441772461 length of segment : 141 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.0008294582366943359 length of segment : 17 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0004329681396484375 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 9.00000 max: 205.00000 molded_images shape: (1, 640, 640, 3) min: -86.59922 max: 73.49688 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -99.93047 max: 150.85391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 1473 time to create 1 rle with old method : 0.0019268989562988281 length of segment : 36 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.00019216537475585938 length of segment : 20 time for calcul the mask position with numpy : 0.0001747608184814453 nb_pixel_total : 8131 time to create 1 rle with old method : 0.009075641632080078 length of segment : 166 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1306 time to create 1 rle with old method : 0.0017108917236328125 length of segment : 32 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.62969 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 1302 time to create 1 rle with old method : 0.0017211437225341797 length of segment : 53 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.00030159950256347656 length of segment : 13 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.00015854835510253906 length of segment : 14 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 767 time to create 1 rle with old method : 0.0010879039764404297 length of segment : 40 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 294 time to create 1 rle with old method : 0.0004246234893798828 length of segment : 15 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.000453948974609375 length of segment : 30 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 482 time to create 1 rle with old method : 0.0007321834564208984 length of segment : 19 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 695 time to create 1 rle with old method : 0.0009133815765380859 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.64141 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 8.988380432128906e-05 nb_pixel_total : 1765 time to create 1 rle with old method : 0.0022232532501220703 length of segment : 123 time for calcul the mask position with numpy : 0.000522613525390625 nb_pixel_total : 31299 time to create 1 rle with old method : 0.03414297103881836 length of segment : 332 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.0003285408020019531 length of segment : 23 time for calcul the mask position with numpy : 0.00034117698669433594 nb_pixel_total : 6452 time to create 1 rle with old method : 0.0076596736907958984 length of segment : 203 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 670 time to create 1 rle with old method : 0.0010089874267578125 length of segment : 36 time for calcul the mask position with numpy : 0.00021529197692871094 nb_pixel_total : 3221 time to create 1 rle with old method : 0.004219532012939453 length of segment : 157 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 1364 time to create 1 rle with old method : 0.0016734600067138672 length of segment : 43 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003364086151123047 length of segment : 18 time for calcul the mask position with numpy : 0.00015211105346679688 nb_pixel_total : 4800 time to create 1 rle with old method : 0.006602287292480469 length of segment : 139 time for calcul the mask position with numpy : 0.00021386146545410156 nb_pixel_total : 8047 time to create 1 rle with old method : 0.009509086608886719 length of segment : 161 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 755 time to create 1 rle with old method : 0.000949859619140625 length of segment : 36 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 781 time to create 1 rle with old method : 0.0009255409240722656 length of segment : 35 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.40078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 1660 time to create 1 rle with old method : 0.003124237060546875 length of segment : 60 time for calcul the mask position with numpy : 9.274482727050781e-05 nb_pixel_total : 1735 time to create 1 rle with old method : 0.003103017807006836 length of segment : 79 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 1647 time to create 1 rle with old method : 0.0032422542572021484 length of segment : 38 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 303 time to create 1 rle with old method : 0.0006401538848876953 length of segment : 17 time for calcul the mask position with numpy : 0.00016736984252929688 nb_pixel_total : 3901 time to create 1 rle with old method : 0.00695037841796875 length of segment : 286 time for calcul the mask position with numpy : 0.00022363662719726562 nb_pixel_total : 3934 time to create 1 rle with old method : 0.0046901702880859375 length of segment : 199 time for calcul the mask position with numpy : 8.58306884765625e-05 nb_pixel_total : 1631 time to create 1 rle with old method : 0.002344846725463867 length of segment : 37 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 197.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 73.22344 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 24 time for calcul the mask position with numpy : 0.00010371208190917969 nb_pixel_total : 3573 time to create 1 rle with old method : 0.004683732986450195 length of segment : 60 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 926 time to create 1 rle with old method : 0.0012810230255126953 length of segment : 50 time for calcul the mask position with numpy : 8.845329284667969e-05 nb_pixel_total : 2264 time to create 1 rle with old method : 0.0031087398529052734 length of segment : 83 time for calcul the mask position with numpy : 8.797645568847656e-05 nb_pixel_total : 1991 time to create 1 rle with old method : 0.0028295516967773438 length of segment : 64 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 903 time to create 1 rle with old method : 0.0013003349304199219 length of segment : 32 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 458 time to create 1 rle with old method : 0.0006778240203857422 length of segment : 28 time for calcul the mask position with numpy : 0.00014090538024902344 nb_pixel_total : 661 time to create 1 rle with old method : 0.001081228256225586 length of segment : 44 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 626 time to create 1 rle with old method : 0.0008871555328369141 length of segment : 46 time for calcul the mask position with numpy : 9.083747863769531e-05 nb_pixel_total : 1486 time to create 1 rle with old method : 0.002740144729614258 length of segment : 49 time for calcul the mask position with numpy : 0.00013566017150878906 nb_pixel_total : 1694 time to create 1 rle with old method : 0.0025789737701416016 length of segment : 50 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 773 time to create 1 rle with old method : 0.0010497570037841797 length of segment : 61 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.0003802776336669922 length of segment : 18 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.0003898143768310547 length of segment : 25 time for calcul the mask position with numpy : 8.20159912109375e-05 nb_pixel_total : 2111 time to create 1 rle with old method : 0.0026535987854003906 length of segment : 77 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.0004475116729736328 length of segment : 22 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 416 time to create 1 rle with old method : 0.0007123947143554688 length of segment : 19 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.0004851818084716797 length of segment : 18 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 264 time to create 1 rle with old method : 0.00043272972106933594 length of segment : 23 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.00045943260192871094 length of segment : 25 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 1045 time to create 1 rle with old method : 0.0014889240264892578 length of segment : 79 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.00043773651123046875 length of segment : 25 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 431 time to create 1 rle with old method : 0.0007414817810058594 length of segment : 16 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.0002300739288330078 length of segment : 11 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 396 time to create 1 rle with old method : 0.0006213188171386719 length of segment : 26 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 61 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 123 time to create 1 rle with old method : 0.0002086162567138672 length of segment : 22 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.00032901763916015625 length of segment : 21 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 414 time to create 1 rle with old method : 0.0005831718444824219 length of segment : 24 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 142 time to create 1 rle with old method : 0.0002465248107910156 length of segment : 16 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.00032973289489746094 length of segment : 14 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.0003466606140136719 length of segment : 28 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.0003161430358886719 length of segment : 18 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 325 time to create 1 rle with old method : 0.0005156993865966797 length of segment : 23 time for calcul the mask position with numpy : 8.463859558105469e-05 nb_pixel_total : 1234 time to create 1 rle with old method : 0.001837015151977539 length of segment : 44 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 305 time to create 1 rle with old method : 0.0004665851593017578 length of segment : 21 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002570152282714844 length of segment : 18 time for calcul the mask position with numpy : 0.00011014938354492188 nb_pixel_total : 2113 time to create 1 rle with old method : 0.0027761459350585938 length of segment : 43 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 679 time to create 1 rle with old method : 0.000986337661743164 length of segment : 37 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 346 time to create 1 rle with old method : 0.0005140304565429688 length of segment : 33 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 521 time to create 1 rle with old method : 0.0007317066192626953 length of segment : 27 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 89 time to create 1 rle with old method : 0.0001697540283203125 length of segment : 10 time for calcul the mask position with numpy : 8.20159912109375e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.00027251243591308594 length of segment : 10 time for calcul the mask position with numpy : 9.131431579589844e-05 nb_pixel_total : 1082 time to create 1 rle with old method : 0.0020618438720703125 length of segment : 49 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.00025725364685058594 length of segment : 18 time for calcul the mask position with numpy : 0.00012350082397460938 nb_pixel_total : 2159 time to create 1 rle with old method : 0.0030858516693115234 length of segment : 64 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.00040841102600097656 length of segment : 17 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 485 time to create 1 rle with old method : 0.0007929801940917969 length of segment : 42 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.00034999847412109375 length of segment : 11 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.0005044937133789062 length of segment : 25 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 332 time to create 1 rle with old method : 0.0005648136138916016 length of segment : 32 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.0005080699920654297 length of segment : 33 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 623 time to create 1 rle with old method : 0.0009267330169677734 length of segment : 48 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.00033092498779296875 length of segment : 18 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 1175 time to create 1 rle with old method : 0.001798868179321289 length of segment : 39 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.000202178955078125 length of segment : 12 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 369 time to create 1 rle with old method : 0.0005733966827392578 length of segment : 26 time for calcul the mask position with numpy : 7.939338684082031e-05 nb_pixel_total : 1801 time to create 1 rle with old method : 0.0024862289428710938 length of segment : 91 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 309 time to create 1 rle with old method : 0.0005061626434326172 length of segment : 19 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.00047397613525390625 length of segment : 23 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.00028824806213378906 length of segment : 8 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0006222724914550781 length of segment : 33 time for calcul the mask position with numpy : 0.0001239776611328125 nb_pixel_total : 2333 time to create 1 rle with old method : 0.0034761428833007812 length of segment : 117 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.0005102157592773438 length of segment : 18 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 720 time to create 1 rle with old method : 0.0011742115020751953 length of segment : 22 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.00022149085998535156 length of segment : 19 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 803 time to create 1 rle with old method : 0.0012125968933105469 length of segment : 34 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 599 time to create 1 rle with old method : 0.0009462833404541016 length of segment : 23 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 362 time to create 1 rle with old method : 0.0005743503570556641 length of segment : 25 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 439 time to create 1 rle with old method : 0.0007317066192626953 length of segment : 36 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 958 time to create 1 rle with old method : 0.0014445781707763672 length of segment : 41 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.0002803802490234375 length of segment : 13 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 1072 time to create 1 rle with old method : 0.0016067028045654297 length of segment : 40 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 50 time to create 1 rle with old method : 9.942054748535156e-05 length of segment : 12 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 1707 time to create 1 rle with old method : 0.0022525787353515625 length of segment : 92 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 318 time to create 1 rle with old method : 0.0004940032958984375 length of segment : 16 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.0002856254577636719 length of segment : 18 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1044 time to create 1 rle with old method : 0.0016527175903320312 length of segment : 31 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.0006418228149414062 length of segment : 21 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.0003943443298339844 length of segment : 15 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 816 time to create 1 rle with old method : 0.0020372867584228516 length of segment : 35 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 341 time to create 1 rle with old method : 0.0005445480346679688 length of segment : 24 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 375 time to create 1 rle with old method : 0.0006344318389892578 length of segment : 24 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 1632 time to create 1 rle with old method : 0.002306699752807617 length of segment : 56 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 1264 time to create 1 rle with old method : 0.0018062591552734375 length of segment : 40 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.0005433559417724609 length of segment : 17 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 785 time to create 1 rle with old method : 0.0011653900146484375 length of segment : 37 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.52187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 1519 time to create 1 rle with old method : 0.002126455307006836 length of segment : 63 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.00033283233642578125 length of segment : 21 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 147 time to create 1 rle with old method : 0.0002162456512451172 length of segment : 25 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.00033402442932128906 length of segment : 28 time for calcul the mask position with numpy : 2.7418136596679688e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.00018930435180664062 length of segment : 8 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 42 time to create 1 rle with old method : 8.273124694824219e-05 length of segment : 17 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 133.22500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0004088878631591797 nb_pixel_total : 26624 time to create 1 rle with old method : 0.02701592445373535 length of segment : 230 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 15 time to create 1 rle with old method : 4.291534423828125e-05 length of segment : 3 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.62188 max: 148.29922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 883 time to create 1 rle with old method : 0.0010631084442138672 length of segment : 36 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 111 time to create 1 rle with old method : 0.0001785755157470703 length of segment : 32 time for calcul the mask position with numpy : 0.00020170211791992188 nb_pixel_total : 7299 time to create 1 rle with old method : 0.010922431945800781 length of segment : 235 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 33 time to create 1 rle with old method : 0.00011277198791503906 length of segment : 14 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.001115560531616211 length of segment : 15 time for calcul the mask position with numpy : 8.511543273925781e-05 nb_pixel_total : 778 time to create 1 rle with old method : 0.0015404224395751953 length of segment : 28 time for calcul the mask position with numpy : 7.867813110351562e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.00030875205993652344 length of segment : 34 time for calcul the mask position with numpy : 0.00023937225341796875 nb_pixel_total : 1024 time to create 1 rle with old method : 0.0023643970489501953 length of segment : 63 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.87188 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1317 time to create 1 rle with old method : 0.0017123222351074219 length of segment : 39 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 2149 time to create 1 rle with old method : 0.002704620361328125 length of segment : 48 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 963 time to create 1 rle with old method : 0.00122833251953125 length of segment : 41 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.00042748451232910156 length of segment : 45 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001842975616455078 length of segment : 11 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 382 time to create 1 rle with old method : 0.0004987716674804688 length of segment : 25 time for calcul the mask position with numpy : 0.00010752677917480469 nb_pixel_total : 4282 time to create 1 rle with old method : 0.005144357681274414 length of segment : 178 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 1627 time to create 1 rle with old method : 0.0019855499267578125 length of segment : 52 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 423 time to create 1 rle with old method : 0.0005035400390625 length of segment : 30 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 2922 time to create 1 rle with old method : 0.003471851348876953 length of segment : 52 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.0003993511199951172 length of segment : 13 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 1274 time to create 1 rle with old method : 0.0015537738800048828 length of segment : 41 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.20000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00010037422180175781 nb_pixel_total : 6365 time to create 1 rle with old method : 0.007021903991699219 length of segment : 115 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 47 time to create 1 rle with old method : 9.703636169433594e-05 length of segment : 7 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 259 time to create 1 rle with old method : 0.00041103363037109375 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.43438 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.0003783702850341797 length of segment : 17 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 1031 time to create 1 rle with old method : 0.001199960708618164 length of segment : 54 time for calcul the mask position with numpy : 0.0001537799835205078 nb_pixel_total : 8621 time to create 1 rle with old method : 0.009369373321533203 length of segment : 140 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002162456512451172 length of segment : 37 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 413 time to create 1 rle with old method : 0.0006384849548339844 length of segment : 24 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.000286102294921875 length of segment : 17 time for calcul the mask position with numpy : 2.6941299438476562e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.0001938343048095703 length of segment : 8 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.90078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.00028586387634277344 length of segment : 23 time for calcul the mask position with numpy : 0.0006542205810546875 nb_pixel_total : 65480 time to create 1 rle with old method : 0.06663894653320312 length of segment : 313 Processing 1 images image shape: (400, 400, 3) min: 5.00000 max: 215.00000 molded_images shape: (1, 640, 640, 3) min: -84.54766 max: 86.15703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -101.51641 max: 150.85391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 2938 time to create 1 rle with old method : 0.003701448440551758 length of segment : 47 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 1348 time to create 1 rle with old method : 0.0016722679138183594 length of segment : 36 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.00021266937255859375 length of segment : 22 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005180835723876953 length of segment : 25 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1169 time to create 1 rle with old method : 0.0013689994812011719 length of segment : 49 time for calcul the mask position with numpy : 0.0001266002655029297 nb_pixel_total : 6496 time to create 1 rle with old method : 0.007479667663574219 length of segment : 107 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0006539821624755859 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -110.20000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 89 time to create 1 rle with old method : 0.00015974044799804688 length of segment : 14 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0003952980041503906 length of segment : 37 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.00032520294189453125 length of segment : 13 time for calcul the mask position with numpy : 8.893013000488281e-05 nb_pixel_total : 3089 time to create 1 rle with old method : 0.003793954849243164 length of segment : 68 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.0004532337188720703 length of segment : 16 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.00859 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.0004899501800537109 length of segment : 39 time for calcul the mask position with numpy : 8.106231689453125e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.0007832050323486328 length of segment : 98 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 935 time to create 1 rle with old method : 0.0013689994812011719 length of segment : 38 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 147 time to create 1 rle with old method : 0.00025916099548339844 length of segment : 36 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003345012664794922 length of segment : 17 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 1393 time to create 1 rle with old method : 0.0016353130340576172 length of segment : 43 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 852 time to create 1 rle with old method : 0.001020193099975586 length of segment : 38 time for calcul the mask position with numpy : 0.0001456737518310547 nb_pixel_total : 4622 time to create 1 rle with old method : 0.005258321762084961 length of segment : 114 time for calcul the mask position with numpy : 0.00017786026000976562 nb_pixel_total : 7369 time to create 1 rle with old method : 0.008359432220458984 length of segment : 180 time for calcul the mask position with numpy : 0.00020360946655273438 nb_pixel_total : 847 time to create 1 rle with old method : 0.0010390281677246094 length of segment : 60 time for calcul the mask position with numpy : 0.000179290771484375 nb_pixel_total : 2376 time to create 1 rle with old method : 0.0029449462890625 length of segment : 74 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 747 time to create 1 rle with old method : 0.0009069442749023438 length of segment : 39 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.10391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 0.00011324882507324219 nb_pixel_total : 3588 time to create 1 rle with old method : 0.0042133331298828125 length of segment : 196 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 1639 time to create 1 rle with old method : 0.0020110607147216797 length of segment : 41 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 677 time to create 1 rle with old method : 0.0008809566497802734 length of segment : 56 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 518 time to create 1 rle with old method : 0.0007576942443847656 length of segment : 28 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1521 time to create 1 rle with old method : 0.001871347427368164 length of segment : 73 time for calcul the mask position with numpy : 0.0002353191375732422 nb_pixel_total : 3462 time to create 1 rle with old method : 0.003989458084106445 length of segment : 216 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 1635 time to create 1 rle with old method : 0.0021262168884277344 length of segment : 38 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1783 time to create 1 rle with old method : 0.0020339488983154297 length of segment : 84 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 1370 time to create 1 rle with old method : 0.0014944076538085938 length of segment : 60 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1581 time to create 1 rle with old method : 0.0017707347869873047 length of segment : 72 time for calcul the mask position with numpy : 0.00014090538024902344 nb_pixel_total : 3019 time to create 1 rle with old method : 0.003288745880126953 length of segment : 166 Processing 1 images image shape: (280, 400, 3) min: 4.00000 max: 204.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 72.40703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0008347034454345703 nb_pixel_total : 106064 time to create 1 rle with old method : 0.11212754249572754 length of segment : 283 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.93984 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 23 time for calcul the mask position with numpy : 9.274482727050781e-05 nb_pixel_total : 2551 time to create 1 rle with old method : 0.0032973289489746094 length of segment : 82 time for calcul the mask position with numpy : 8.845329284667969e-05 nb_pixel_total : 3654 time to create 1 rle with old method : 0.0042684078216552734 length of segment : 63 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 1756 time to create 1 rle with old method : 0.002317667007446289 length of segment : 43 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 574 time to create 1 rle with old method : 0.0008530616760253906 length of segment : 44 time for calcul the mask position with numpy : 8.368492126464844e-05 nb_pixel_total : 1835 time to create 1 rle with old method : 0.0026319026947021484 length of segment : 75 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 765 time to create 1 rle with old method : 0.000949859619140625 length of segment : 65 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 919 time to create 1 rle with old method : 0.0011851787567138672 length of segment : 35 time for calcul the mask position with numpy : 9.322166442871094e-05 nb_pixel_total : 1854 time to create 1 rle with old method : 0.002586841583251953 length of segment : 50 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 820 time to create 1 rle with old method : 0.0010724067687988281 length of segment : 47 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 300 time to create 1 rle with old method : 0.0006442070007324219 length of segment : 19 time for calcul the mask position with numpy : 9.608268737792969e-05 nb_pixel_total : 2513 time to create 1 rle with old method : 0.003785371780395508 length of segment : 83 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.00038170814514160156 length of segment : 34 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 441 time to create 1 rle with old method : 0.0005903244018554688 length of segment : 20 time for calcul the mask position with numpy : 8.535385131835938e-05 nb_pixel_total : 886 time to create 1 rle with old method : 0.001413583755493164 length of segment : 75 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.00035262107849121094 length of segment : 18 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.00039315223693847656 length of segment : 25 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 418 time to create 1 rle with old method : 0.0005743503570556641 length of segment : 25 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.0005824565887451172 length of segment : 26 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001766681671142578 length of segment : 11 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 898 time to create 1 rle with old method : 0.0014376640319824219 length of segment : 24 time for calcul the mask position with numpy : 0.00010466575622558594 nb_pixel_total : 2453 time to create 1 rle with old method : 0.003103971481323242 length of segment : 82 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.00041031837463378906 length of segment : 29 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005736351013183594 length of segment : 21 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 59 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 401 time to create 1 rle with old method : 0.0005328655242919922 length of segment : 24 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 2170 time to create 1 rle with old method : 0.0026743412017822266 length of segment : 43 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005366802215576172 length of segment : 30 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 648 time to create 1 rle with old method : 0.0007700920104980469 length of segment : 48 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.00032973289489746094 length of segment : 17 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.00043654441833496094 length of segment : 37 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.00042819976806640625 length of segment : 21 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 551 time to create 1 rle with old method : 0.0006861686706542969 length of segment : 28 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.000240325927734375 length of segment : 15 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.00016736984252929688 length of segment : 17 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 662 time to create 1 rle with old method : 0.0008041858673095703 length of segment : 46 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.0004889965057373047 length of segment : 20 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 49 time to create 1 rle with old method : 0.000102996826171875 length of segment : 6 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.0003006458282470703 length of segment : 23 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.00016641616821289062 length of segment : 16 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.00044608116149902344 length of segment : 24 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 378 time to create 1 rle with old method : 0.0004942417144775391 length of segment : 34 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006704330444335938 length of segment : 27 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 315 time to create 1 rle with old method : 0.0004489421844482422 length of segment : 18 time for calcul the mask position with numpy : 7.939338684082031e-05 nb_pixel_total : 1359 time to create 1 rle with old method : 0.0017199516296386719 length of segment : 53 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 1574 time to create 1 rle with old method : 0.0017981529235839844 length of segment : 88 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 453 time to create 1 rle with old method : 0.0005936622619628906 length of segment : 30 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002646446228027344 length of segment : 21 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 351 time to create 1 rle with old method : 0.0004658699035644531 length of segment : 22 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.00040459632873535156 length of segment : 17 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 504 time to create 1 rle with old method : 0.0006251335144042969 length of segment : 48 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 1740 time to create 1 rle with old method : 0.0021622180938720703 length of segment : 59 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.00023221969604492188 length of segment : 19 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 805 time to create 1 rle with old method : 0.0009789466857910156 length of segment : 55 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.0003676414489746094 length of segment : 23 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.0003006458282470703 length of segment : 24 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 1020 time to create 1 rle with old method : 0.001238107681274414 length of segment : 30 time for calcul the mask position with numpy : 9.584426879882812e-05 nb_pixel_total : 3968 time to create 1 rle with old method : 0.00450587272644043 length of segment : 83 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 71 time to create 1 rle with old method : 0.00010466575622558594 length of segment : 15 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 300 time to create 1 rle with old method : 0.0004210472106933594 length of segment : 22 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.00041794776916503906 length of segment : 26 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.00021219253540039062 length of segment : 17 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002498626708984375 length of segment : 17 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1385 time to create 1 rle with old method : 0.0016906261444091797 length of segment : 51 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 1317 time to create 1 rle with old method : 0.0015478134155273438 length of segment : 48 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.0003540515899658203 length of segment : 15 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.00031375885009765625 length of segment : 29 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 1189 time to create 1 rle with old method : 0.0014715194702148438 length of segment : 77 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 787 time to create 1 rle with old method : 0.0009546279907226562 length of segment : 40 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 325 time to create 1 rle with old method : 0.0004589557647705078 length of segment : 21 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 1193 time to create 1 rle with old method : 0.0014476776123046875 length of segment : 40 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 299 time to create 1 rle with old method : 0.0007154941558837891 length of segment : 16 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 1201 time to create 1 rle with old method : 0.0017991065979003906 length of segment : 36 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 340 time to create 1 rle with old method : 0.0005476474761962891 length of segment : 23 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.0004508495330810547 length of segment : 16 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 589 time to create 1 rle with old method : 0.0007524490356445312 length of segment : 24 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.00027871131896972656 length of segment : 19 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002796649932861328 length of segment : 18 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 827 time to create 1 rle with old method : 0.000985860824584961 length of segment : 34 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 685 time to create 1 rle with old method : 0.0007789134979248047 length of segment : 32 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0004928112030029297 length of segment : 27 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 710 time to create 1 rle with old method : 0.0008108615875244141 length of segment : 35 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 841 time to create 1 rle with old method : 0.000995635986328125 length of segment : 35 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 305 time to create 1 rle with old method : 0.0003972053527832031 length of segment : 16 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.05312 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1342 time to create 1 rle with old method : 0.0015211105346679688 length of segment : 63 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 564 time to create 1 rle with old method : 0.0007045269012451172 length of segment : 32 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.0001995563507080078 length of segment : 22 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.000278472900390625 length of segment : 24 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 63 time to create 1 rle with old method : 0.00011587142944335938 length of segment : 20 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0003497600555419922 length of segment : 22 time for calcul the mask position with numpy : 2.6702880859375e-05 nb_pixel_total : 38 time to create 1 rle with old method : 6.771087646484375e-05 length of segment : 14 time for calcul the mask position with numpy : 2.7179718017578125e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.00019478797912597656 length of segment : 8 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 887 time to create 1 rle with old method : 0.0011284351348876953 length of segment : 38 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 130.03750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 15 time to create 1 rle with old method : 8.916854858398438e-05 length of segment : 3 Detection mask done ! Trying to reset tf kernel 502416 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5152 tf kernel not reseted sub process len(results) : 324 len(list_Values) 324 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 324 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10441 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 324 chid ids of type : 4228 Number RLEs to save : 14904 save missing photos in datou_result : time spend for datou_step_exec : 23.435481071472168 time spend to save output : 1.1774122714996338 total time spend for step 1 : 24.6128933429718 step2:brightness Sat Feb 15 10:20:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739611229_501992_1337667504_b23baecf10f89782c8e8de5bc1ccdaa7.jpg treat image : temp/1739611229_501992_1337667471_1b1a1a96b687d05c3c22ec00220a96f5.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.011433124542236328 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.011157512664794922 save missing photos in datou_result : time spend for datou_step_exec : 0.5037331581115723 time spend to save output : 0.027578353881835938 total time spend for step 2 : 0.5313115119934082 step3:blur_detection Sat Feb 15 10:20:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739611229_501992_1337667504_b23baecf10f89782c8e8de5bc1ccdaa7.jpg resize: (1080, 1920) 1337667504 -7.7533077717949315 treat image : temp/1739611229_501992_1337667471_1b1a1a96b687d05c3c22ec00220a96f5.jpg resize: (1080, 1920) 1337667471 -7.756930965779299 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.01297140121459961 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.01070404052734375 save missing photos in datou_result : time spend for datou_step_exec : 2.0067381858825684 time spend to save output : 0.028496265411376953 total time spend for step 3 : 2.0352344512939453 step4:rle_unique_nms_with_priority Sat Feb 15 10:20:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 324 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 164 nb_hashtags : 7 time to prepare the origin masks : 0.9536025524139404 time for calcul the mask position with numpy : 0.290968656539917 nb_pixel_total : 1873358 time to create 1 rle with new method : 0.09065055847167969 time for calcul the mask position with numpy : 0.008378982543945312 nb_pixel_total : 116 time to create 1 rle with old method : 0.00015401840209960938 time for calcul the mask position with numpy : 0.008138895034790039 nb_pixel_total : 61 time to create 1 rle with old method : 8.630752563476562e-05 time for calcul the mask position with numpy : 0.008172988891601562 nb_pixel_total : 1326 time to create 1 rle with old method : 0.0014281272888183594 time for calcul the mask position with numpy : 0.007929563522338867 nb_pixel_total : 805 time to create 1 rle with old method : 0.0008704662322998047 time for calcul the mask position with numpy : 0.008174896240234375 nb_pixel_total : 30 time to create 1 rle with old method : 5.1021575927734375e-05 time for calcul the mask position with numpy : 0.008233070373535156 nb_pixel_total : 81 time to create 1 rle with old method : 8.940696716308594e-05 time for calcul the mask position with numpy : 0.008026599884033203 nb_pixel_total : 26 time to create 1 rle with old method : 4.7206878662109375e-05 time for calcul the mask position with numpy : 0.008117914199829102 nb_pixel_total : 1357 time to create 1 rle with old method : 0.0013988018035888672 time for calcul the mask position with numpy : 0.007750272750854492 nb_pixel_total : 868 time to create 1 rle with old method : 0.0009238719940185547 time for calcul the mask position with numpy : 0.00795292854309082 nb_pixel_total : 90 time to create 1 rle with old method : 0.00010561943054199219 time for calcul the mask position with numpy : 0.00805521011352539 nb_pixel_total : 1480 time to create 1 rle with old method : 0.0016355514526367188 time for calcul the mask position with numpy : 0.008096933364868164 nb_pixel_total : 121 time to create 1 rle with old method : 0.00016880035400390625 time for calcul the mask position with numpy : 0.008013248443603516 nb_pixel_total : 28 time to create 1 rle with old method : 6.29425048828125e-05 time for calcul the mask position with numpy : 0.007979631423950195 nb_pixel_total : 18 time to create 1 rle with old method : 2.5987625122070312e-05 time for calcul the mask position with numpy : 0.007901668548583984 nb_pixel_total : 2127 time to create 1 rle with old method : 0.0023953914642333984 time for calcul the mask position with numpy : 0.007828950881958008 nb_pixel_total : 82 time to create 1 rle with old method : 0.00010204315185546875 time for calcul the mask position with numpy : 0.008170843124389648 nb_pixel_total : 167 time to create 1 rle with old method : 0.00019359588623046875 time for calcul the mask position with numpy : 0.008185625076293945 nb_pixel_total : 565 time to create 1 rle with old method : 0.0006189346313476562 time for calcul the mask position with numpy : 0.008035421371459961 nb_pixel_total : 968 time to create 1 rle with old method : 0.001020669937133789 time for calcul the mask position with numpy : 0.007850170135498047 nb_pixel_total : 2419 time to create 1 rle with old method : 0.0027811527252197266 time for calcul the mask position with numpy : 0.008028745651245117 nb_pixel_total : 788 time to create 1 rle with old method : 0.0008268356323242188 time for calcul the mask position with numpy : 0.008068561553955078 nb_pixel_total : 247 time to create 1 rle with old method : 0.0002777576446533203 time for calcul the mask position with numpy : 0.007805585861206055 nb_pixel_total : 498 time to create 1 rle with old method : 0.0005486011505126953 time for calcul the mask position with numpy : 0.007907390594482422 nb_pixel_total : 301 time to create 1 rle with old method : 0.00034117698669433594 time for calcul the mask position with numpy : 0.007811546325683594 nb_pixel_total : 260 time to create 1 rle with old method : 0.0002999305725097656 time for calcul the mask position with numpy : 0.00783228874206543 nb_pixel_total : 1121 time to create 1 rle with old method : 0.0011854171752929688 time for calcul the mask position with numpy : 0.007885217666625977 nb_pixel_total : 222 time to create 1 rle with old method : 0.0002384185791015625 time for calcul the mask position with numpy : 0.007829666137695312 nb_pixel_total : 430 time to create 1 rle with old method : 0.00048065185546875 time for calcul the mask position with numpy : 0.00787043571472168 nb_pixel_total : 64 time to create 1 rle with old method : 0.00011396408081054688 time for calcul the mask position with numpy : 0.007780790328979492 nb_pixel_total : 12 time to create 1 rle with old method : 4.9114227294921875e-05 time for calcul the mask position with numpy : 0.0077822208404541016 nb_pixel_total : 17 time to create 1 rle with old method : 4.100799560546875e-05 time for calcul the mask position with numpy : 0.007930994033813477 nb_pixel_total : 1614 time to create 1 rle with old method : 0.0017039775848388672 time for calcul the mask position with numpy : 0.008105993270874023 nb_pixel_total : 1193 time to create 1 rle with old method : 0.001363992691040039 time for calcul the mask position with numpy : 0.008009195327758789 nb_pixel_total : 980 time to create 1 rle with old method : 0.001190185546875 time for calcul the mask position with numpy : 0.008337259292602539 nb_pixel_total : 222 time to create 1 rle with old method : 0.00028634071350097656 time for calcul the mask position with numpy : 0.008221149444580078 nb_pixel_total : 6591 time to create 1 rle with old method : 0.0070972442626953125 time for calcul the mask position with numpy : 0.00822901725769043 nb_pixel_total : 8121 time to create 1 rle with old method : 0.008839607238769531 time for calcul the mask position with numpy : 0.007937192916870117 nb_pixel_total : 158 time to create 1 rle with old method : 0.00018453598022460938 time for calcul the mask position with numpy : 0.008245229721069336 nb_pixel_total : 3145 time to create 1 rle with old method : 0.0033102035522460938 time for calcul the mask position with numpy : 0.00782918930053711 nb_pixel_total : 477 time to create 1 rle with old method : 0.0005125999450683594 time for calcul the mask position with numpy : 0.007994651794433594 nb_pixel_total : 3251 time to create 1 rle with old method : 0.0035552978515625 time for calcul the mask position with numpy : 0.008019447326660156 nb_pixel_total : 4800 time to create 1 rle with old method : 0.005307197570800781 time for calcul the mask position with numpy : 0.00818490982055664 nb_pixel_total : 482 time to create 1 rle with old method : 0.0006468296051025391 time for calcul the mask position with numpy : 0.008110284805297852 nb_pixel_total : 3221 time to create 1 rle with old method : 0.0035812854766845703 time for calcul the mask position with numpy : 0.008091926574707031 nb_pixel_total : 695 time to create 1 rle with old method : 0.0007772445678710938 time for calcul the mask position with numpy : 0.008217811584472656 nb_pixel_total : 101 time to create 1 rle with old method : 0.00013947486877441406 time for calcul the mask position with numpy : 0.008127927780151367 nb_pixel_total : 755 time to create 1 rle with old method : 0.0008003711700439453 time for calcul the mask position with numpy : 0.008089780807495117 nb_pixel_total : 767 time to create 1 rle with old method : 0.0008447170257568359 time for calcul the mask position with numpy : 0.008206605911254883 nb_pixel_total : 1364 time to create 1 rle with old method : 0.0014376640319824219 time for calcul the mask position with numpy : 0.008130073547363281 nb_pixel_total : 31299 time to create 1 rle with old method : 0.03640151023864746 time for calcul the mask position with numpy : 0.008352994918823242 nb_pixel_total : 1647 time to create 1 rle with old method : 0.001848459243774414 time for calcul the mask position with numpy : 0.008241653442382812 nb_pixel_total : 223 time to create 1 rle with old method : 0.0002741813659667969 time for calcul the mask position with numpy : 0.008296489715576172 nb_pixel_total : 1302 time to create 1 rle with old method : 0.0013730525970458984 time for calcul the mask position with numpy : 0.008191585540771484 nb_pixel_total : 31 time to create 1 rle with old method : 7.081031799316406e-05 time for calcul the mask position with numpy : 0.008119821548461914 nb_pixel_total : 8131 time to create 1 rle with old method : 0.008659839630126953 time for calcul the mask position with numpy : 0.007959127426147461 nb_pixel_total : 303 time to create 1 rle with old method : 0.00033664703369140625 time for calcul the mask position with numpy : 0.008081197738647461 nb_pixel_total : 3934 time to create 1 rle with old method : 0.004575252532958984 time for calcul the mask position with numpy : 0.008213996887207031 nb_pixel_total : 1765 time to create 1 rle with old method : 0.00203704833984375 time for calcul the mask position with numpy : 0.008238792419433594 nb_pixel_total : 239 time to create 1 rle with old method : 0.00028204917907714844 time for calcul the mask position with numpy : 0.008098840713500977 nb_pixel_total : 3901 time to create 1 rle with old method : 0.00429224967956543 time for calcul the mask position with numpy : 0.008332490921020508 nb_pixel_total : 1660 time to create 1 rle with old method : 0.0018382072448730469 time for calcul the mask position with numpy : 0.008213520050048828 nb_pixel_total : 93 time to create 1 rle with old method : 0.00011229515075683594 time for calcul the mask position with numpy : 0.008043766021728516 nb_pixel_total : 6452 time to create 1 rle with old method : 0.007198333740234375 time for calcul the mask position with numpy : 0.008108854293823242 nb_pixel_total : 198 time to create 1 rle with old method : 0.0002944469451904297 time for calcul the mask position with numpy : 0.00829768180847168 nb_pixel_total : 1735 time to create 1 rle with old method : 0.0019545555114746094 time for calcul the mask position with numpy : 0.008342742919921875 nb_pixel_total : 1473 time to create 1 rle with old method : 0.0016942024230957031 time for calcul the mask position with numpy : 0.00827932357788086 nb_pixel_total : 1306 time to create 1 rle with old method : 0.0014884471893310547 time for calcul the mask position with numpy : 0.008206367492675781 nb_pixel_total : 301 time to create 1 rle with old method : 0.00039267539978027344 time for calcul the mask position with numpy : 0.008231401443481445 nb_pixel_total : 133 time to create 1 rle with old method : 0.00014591217041015625 time for calcul the mask position with numpy : 0.00822138786315918 nb_pixel_total : 195 time to create 1 rle with old method : 0.00023627281188964844 time for calcul the mask position with numpy : 0.008164167404174805 nb_pixel_total : 294 time to create 1 rle with old method : 0.0003387928009033203 time for calcul the mask position with numpy : 0.008293867111206055 nb_pixel_total : 626 time to create 1 rle with old method : 0.0007212162017822266 time for calcul the mask position with numpy : 0.008238554000854492 nb_pixel_total : 3573 time to create 1 rle with old method : 0.003918647766113281 time for calcul the mask position with numpy : 0.008096933364868164 nb_pixel_total : 341 time to create 1 rle with old method : 0.0003998279571533203 time for calcul the mask position with numpy : 0.008093595504760742 nb_pixel_total : 2264 time to create 1 rle with old method : 0.0025475025177001953 time for calcul the mask position with numpy : 0.008251190185546875 nb_pixel_total : 291 time to create 1 rle with old method : 0.000335693359375 time for calcul the mask position with numpy : 0.00805521011352539 nb_pixel_total : 2147 time to create 1 rle with old method : 0.0023169517517089844 time for calcul the mask position with numpy : 0.008207559585571289 nb_pixel_total : 145 time to create 1 rle with old method : 0.00017452239990234375 time for calcul the mask position with numpy : 0.008167505264282227 nb_pixel_total : 207 time to create 1 rle with old method : 0.00023174285888671875 time for calcul the mask position with numpy : 0.008133172988891602 nb_pixel_total : 264 time to create 1 rle with old method : 0.00031495094299316406 time for calcul the mask position with numpy : 0.008210182189941406 nb_pixel_total : 267 time to create 1 rle with old method : 0.00028824806213378906 time for calcul the mask position with numpy : 0.008129358291625977 nb_pixel_total : 58 time to create 1 rle with old method : 0.00011467933654785156 time for calcul the mask position with numpy : 0.007957696914672852 nb_pixel_total : 903 time to create 1 rle with old method : 0.001008749008178711 time for calcul the mask position with numpy : 0.008301973342895508 nb_pixel_total : 235 time to create 1 rle with old method : 0.00028514862060546875 time for calcul the mask position with numpy : 0.008310794830322266 nb_pixel_total : 26624 time to create 1 rle with old method : 0.027312278747558594 time for calcul the mask position with numpy : 0.008090734481811523 nb_pixel_total : 202 time to create 1 rle with old method : 0.00023102760314941406 time for calcul the mask position with numpy : 0.008191585540771484 nb_pixel_total : 25 time to create 1 rle with old method : 3.600120544433594e-05 time for calcul the mask position with numpy : 0.008310079574584961 nb_pixel_total : 150 time to create 1 rle with old method : 0.00017309188842773438 time for calcul the mask position with numpy : 0.008197307586669922 nb_pixel_total : 225 time to create 1 rle with old method : 0.0002777576446533203 time for calcul the mask position with numpy : 0.00826120376586914 nb_pixel_total : 97 time to create 1 rle with old method : 0.00011467933654785156 time for calcul the mask position with numpy : 0.008225440979003906 nb_pixel_total : 1082 time to create 1 rle with old method : 0.0012366771697998047 time for calcul the mask position with numpy : 0.008254528045654297 nb_pixel_total : 2111 time to create 1 rle with old method : 0.002195596694946289 time for calcul the mask position with numpy : 0.008229255676269531 nb_pixel_total : 431 time to create 1 rle with old method : 0.0004949569702148438 time for calcul the mask position with numpy : 0.008239030838012695 nb_pixel_total : 458 time to create 1 rle with old method : 0.0005123615264892578 time for calcul the mask position with numpy : 0.008344650268554688 nb_pixel_total : 720 time to create 1 rle with old method : 0.0008664131164550781 time for calcul the mask position with numpy : 0.008310794830322266 nb_pixel_total : 416 time to create 1 rle with old method : 0.0004885196685791016 time for calcul the mask position with numpy : 0.00826883316040039 nb_pixel_total : 599 time to create 1 rle with old method : 0.0007002353668212891 time for calcul the mask position with numpy : 0.008277654647827148 nb_pixel_total : 784 time to create 1 rle with old method : 0.0009303092956542969 time for calcul the mask position with numpy : 0.008342981338500977 nb_pixel_total : 257 time to create 1 rle with old method : 0.0003161430358886719 time for calcul the mask position with numpy : 0.008208751678466797 nb_pixel_total : 89 time to create 1 rle with old method : 0.00010800361633300781 time for calcul the mask position with numpy : 0.008320808410644531 nb_pixel_total : 926 time to create 1 rle with old method : 0.0009932518005371094 time for calcul the mask position with numpy : 0.008361339569091797 nb_pixel_total : 1991 time to create 1 rle with old method : 0.002360105514526367 time for calcul the mask position with numpy : 0.008210897445678711 nb_pixel_total : 1234 time to create 1 rle with old method : 0.00133514404296875 time for calcul the mask position with numpy : 0.008319854736328125 nb_pixel_total : 346 time to create 1 rle with old method : 0.0004036426544189453 time for calcul the mask position with numpy : 0.00821232795715332 nb_pixel_total : 123 time to create 1 rle with old method : 0.00014066696166992188 time for calcul the mask position with numpy : 0.008298397064208984 nb_pixel_total : 1632 time to create 1 rle with old method : 0.0018055438995361328 time for calcul the mask position with numpy : 0.00822138786315918 nb_pixel_total : 369 time to create 1 rle with old method : 0.0004165172576904297 time for calcul the mask position with numpy : 0.008282899856567383 nb_pixel_total : 98 time to create 1 rle with old method : 0.00011587142944335938 time for calcul the mask position with numpy : 0.008018970489501953 nb_pixel_total : 623 time to create 1 rle with old method : 0.0007150173187255859 time for calcul the mask position with numpy : 0.008269548416137695 nb_pixel_total : 26 time to create 1 rle with old method : 6.0558319091796875e-05 time for calcul the mask position with numpy : 0.008138656616210938 nb_pixel_total : 20 time to create 1 rle with old method : 4.267692565917969e-05 time for calcul the mask position with numpy : 0.008204936981201172 nb_pixel_total : 803 time to create 1 rle with old method : 0.0009369850158691406 time for calcul the mask position with numpy : 0.008260726928710938 nb_pixel_total : 1044 time to create 1 rle with old method : 0.0011289119720458984 time for calcul the mask position with numpy : 0.008440732955932617 nb_pixel_total : 142 time to create 1 rle with old method : 0.0001823902130126953 time for calcul the mask position with numpy : 0.008345365524291992 nb_pixel_total : 42 time to create 1 rle with old method : 5.9604644775390625e-05 time for calcul the mask position with numpy : 0.008274316787719727 nb_pixel_total : 315 time to create 1 rle with old method : 0.0003848075866699219 time for calcul the mask position with numpy : 0.008586406707763672 nb_pixel_total : 317 time to create 1 rle with old method : 0.0003502368927001953 time for calcul the mask position with numpy : 0.00831294059753418 nb_pixel_total : 179 time to create 1 rle with old method : 0.0002315044403076172 time for calcul the mask position with numpy : 0.008431196212768555 nb_pixel_total : 958 time to create 1 rle with old method : 0.001142263412475586 time for calcul the mask position with numpy : 0.00908803939819336 nb_pixel_total : 1069 time to create 1 rle with old method : 0.0012722015380859375 time for calcul the mask position with numpy : 0.008825540542602539 nb_pixel_total : 275 time to create 1 rle with old method : 0.00043511390686035156 time for calcul the mask position with numpy : 0.00833749771118164 nb_pixel_total : 1486 time to create 1 rle with old method : 0.0016787052154541016 time for calcul the mask position with numpy : 0.008729219436645508 nb_pixel_total : 110 time to create 1 rle with old method : 0.00016951560974121094 time for calcul the mask position with numpy : 0.009572267532348633 nb_pixel_total : 135 time to create 1 rle with old method : 0.00017571449279785156 time for calcul the mask position with numpy : 0.00811624526977539 nb_pixel_total : 679 time to create 1 rle with old method : 0.0008037090301513672 time for calcul the mask position with numpy : 0.008126974105834961 nb_pixel_total : 213 time to create 1 rle with old method : 0.0002601146697998047 time for calcul the mask position with numpy : 0.008210897445678711 nb_pixel_total : 267 time to create 1 rle with old method : 0.0002961158752441406 time for calcul the mask position with numpy : 0.008142948150634766 nb_pixel_total : 196 time to create 1 rle with old method : 0.00022530555725097656 time for calcul the mask position with numpy : 0.008275032043457031 nb_pixel_total : 439 time to create 1 rle with old method : 0.0005290508270263672 time for calcul the mask position with numpy : 0.008418083190917969 nb_pixel_total : 325 time to create 1 rle with old method : 0.0003981590270996094 time for calcul the mask position with numpy : 0.008925914764404297 nb_pixel_total : 299 time to create 1 rle with old method : 0.00037670135498046875 time for calcul the mask position with numpy : 0.00899362564086914 nb_pixel_total : 82 time to create 1 rle with old method : 0.00010275840759277344 time for calcul the mask position with numpy : 0.009005546569824219 nb_pixel_total : 234 time to create 1 rle with old method : 0.0002930164337158203 time for calcul the mask position with numpy : 0.00925135612487793 nb_pixel_total : 773 time to create 1 rle with old method : 0.0009133815765380859 time for calcul the mask position with numpy : 0.00922846794128418 nb_pixel_total : 162 time to create 1 rle with old method : 0.00021791458129882812 time for calcul the mask position with numpy : 0.009105443954467773 nb_pixel_total : 147 time to create 1 rle with old method : 0.00019240379333496094 time for calcul the mask position with numpy : 0.008630752563476562 nb_pixel_total : 1045 time to create 1 rle with old method : 0.0012001991271972656 time for calcul the mask position with numpy : 0.008287429809570312 nb_pixel_total : 1801 time to create 1 rle with old method : 0.002093791961669922 time for calcul the mask position with numpy : 0.008403301239013672 nb_pixel_total : 309 time to create 1 rle with old method : 0.0003600120544433594 time for calcul the mask position with numpy : 0.008143424987792969 nb_pixel_total : 317 time to create 1 rle with old method : 0.00038051605224609375 time for calcul the mask position with numpy : 0.008301734924316406 nb_pixel_total : 200 time to create 1 rle with old method : 0.00023412704467773438 time for calcul the mask position with numpy : 0.008383512496948242 nb_pixel_total : 2333 time to create 1 rle with old method : 0.0026242733001708984 time for calcul the mask position with numpy : 0.008356094360351562 nb_pixel_total : 15 time to create 1 rle with old method : 2.1457672119140625e-05 time for calcul the mask position with numpy : 0.00827932357788086 nb_pixel_total : 157 time to create 1 rle with old method : 0.00019931793212890625 time for calcul the mask position with numpy : 0.008282899856567383 nb_pixel_total : 1519 time to create 1 rle with old method : 0.0017542839050292969 time for calcul the mask position with numpy : 0.008327484130859375 nb_pixel_total : 342 time to create 1 rle with old method : 0.0003807544708251953 time for calcul the mask position with numpy : 0.008263587951660156 nb_pixel_total : 305 time to create 1 rle with old method : 0.0003437995910644531 time for calcul the mask position with numpy : 0.008761882781982422 nb_pixel_total : 521 time to create 1 rle with old method : 0.0006492137908935547 time for calcul the mask position with numpy : 0.008955240249633789 nb_pixel_total : 10 time to create 1 rle with old method : 3.528594970703125e-05 time for calcul the mask position with numpy : 0.00921630859375 nb_pixel_total : 485 time to create 1 rle with old method : 0.0006678104400634766 time for calcul the mask position with numpy : 0.008949041366577148 nb_pixel_total : 396 time to create 1 rle with old method : 0.00046181678771972656 time for calcul the mask position with numpy : 0.008275270462036133 nb_pixel_total : 1175 time to create 1 rle with old method : 0.001383066177368164 time for calcul the mask position with numpy : 0.008278608322143555 nb_pixel_total : 129 time to create 1 rle with old method : 0.0001976490020751953 time for calcul the mask position with numpy : 0.008394718170166016 nb_pixel_total : 362 time to create 1 rle with old method : 0.0004317760467529297 time for calcul the mask position with numpy : 0.008180856704711914 nb_pixel_total : 2113 time to create 1 rle with old method : 0.002420663833618164 time for calcul the mask position with numpy : 0.008285284042358398 nb_pixel_total : 414 time to create 1 rle with old method : 0.0004906654357910156 time for calcul the mask position with numpy : 0.008335590362548828 nb_pixel_total : 318 time to create 1 rle with old method : 0.00035071372985839844 time for calcul the mask position with numpy : 0.008232355117797852 nb_pixel_total : 18 time to create 1 rle with old method : 3.5762786865234375e-05 time for calcul the mask position with numpy : 0.008120059967041016 nb_pixel_total : 17 time to create 1 rle with old method : 3.600120544433594e-05 time for calcul the mask position with numpy : 0.008238554000854492 nb_pixel_total : 375 time to create 1 rle with old method : 0.0004482269287109375 time for calcul the mask position with numpy : 0.008271932601928711 nb_pixel_total : 307 time to create 1 rle with old method : 0.0003447532653808594 time for calcul the mask position with numpy : 0.008288383483886719 nb_pixel_total : 31 time to create 1 rle with old method : 6.389617919921875e-05 time for calcul the mask position with numpy : 0.00822305679321289 nb_pixel_total : 185 time to create 1 rle with old method : 0.00021719932556152344 time for calcul the mask position with numpy : 0.00821685791015625 nb_pixel_total : 126 time to create 1 rle with old method : 0.0001373291015625 create new chi : 1.9707918167114258 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.006944894790649414 batch 1 Loaded 165 chid ids of type : 4230 Number RLEs to save : 14891 TO DO : save crop sub photo not yet done ! save time : 1.6534404754638672 nb_obj : 160 nb_hashtags : 8 time to prepare the origin masks : 2.4262170791625977 time for calcul the mask position with numpy : 0.032128334045410156 nb_pixel_total : 1761643 time to create 1 rle with new method : 0.08996129035949707 time for calcul the mask position with numpy : 0.0072023868560791016 nb_pixel_total : 2922 time to create 1 rle with old method : 0.003361225128173828 time for calcul the mask position with numpy : 0.006049156188964844 nb_pixel_total : 262 time to create 1 rle with old method : 0.0003323554992675781 time for calcul the mask position with numpy : 0.006926536560058594 nb_pixel_total : 65480 time to create 1 rle with old method : 0.06927227973937988 time for calcul the mask position with numpy : 0.005995512008666992 nb_pixel_total : 38 time to create 1 rle with old method : 6.961822509765625e-05 time for calcul the mask position with numpy : 0.0060040950775146484 nb_pixel_total : 883 time to create 1 rle with old method : 0.0009753704071044922 time for calcul the mask position with numpy : 0.005954265594482422 nb_pixel_total : 33 time to create 1 rle with old method : 5.745887756347656e-05 time for calcul the mask position with numpy : 0.0059697628021240234 nb_pixel_total : 963 time to create 1 rle with old method : 0.0010945796966552734 time for calcul the mask position with numpy : 0.006118059158325195 nb_pixel_total : 1317 time to create 1 rle with old method : 0.0015146732330322266 time for calcul the mask position with numpy : 0.009780645370483398 nb_pixel_total : 5 time to create 1 rle with old method : 2.7894973754882812e-05 time for calcul the mask position with numpy : 0.009862184524536133 nb_pixel_total : 1024 time to create 1 rle with old method : 0.001161813735961914 time for calcul the mask position with numpy : 0.009914875030517578 nb_pixel_total : 111 time to create 1 rle with old method : 0.0001533031463623047 time for calcul the mask position with numpy : 0.00984954833984375 nb_pixel_total : 29 time to create 1 rle with old method : 7.748603820800781e-05 time for calcul the mask position with numpy : 0.009673118591308594 nb_pixel_total : 2149 time to create 1 rle with old method : 0.002379179000854492 time for calcul the mask position with numpy : 0.009969472885131836 nb_pixel_total : 47 time to create 1 rle with old method : 7.724761962890625e-05 time for calcul the mask position with numpy : 0.00967264175415039 nb_pixel_total : 118 time to create 1 rle with old method : 0.00015401840209960938 time for calcul the mask position with numpy : 0.009757280349731445 nb_pixel_total : 312 time to create 1 rle with old method : 0.00039458274841308594 time for calcul the mask position with numpy : 0.009709358215332031 nb_pixel_total : 7299 time to create 1 rle with old method : 0.008040189743041992 time for calcul the mask position with numpy : 0.00989079475402832 nb_pixel_total : 945 time to create 1 rle with old method : 0.001077413558959961 time for calcul the mask position with numpy : 0.009862422943115234 nb_pixel_total : 159 time to create 1 rle with old method : 0.000209808349609375 time for calcul the mask position with numpy : 0.009663105010986328 nb_pixel_total : 243 time to create 1 rle with old method : 0.00027251243591308594 time for calcul the mask position with numpy : 0.009745597839355469 nb_pixel_total : 49 time to create 1 rle with old method : 7.343292236328125e-05 time for calcul the mask position with numpy : 0.009645700454711914 nb_pixel_total : 236 time to create 1 rle with old method : 0.0002791881561279297 time for calcul the mask position with numpy : 0.009673833847045898 nb_pixel_total : 382 time to create 1 rle with old method : 0.0004172325134277344 time for calcul the mask position with numpy : 0.009623050689697266 nb_pixel_total : 259 time to create 1 rle with old method : 0.00029778480529785156 time for calcul the mask position with numpy : 0.00961446762084961 nb_pixel_total : 227 time to create 1 rle with old method : 0.0002541542053222656 time for calcul the mask position with numpy : 0.009718894958496094 nb_pixel_total : 413 time to create 1 rle with old method : 0.0004987716674804688 time for calcul the mask position with numpy : 0.009458541870117188 nb_pixel_total : 1315 time to create 1 rle with old method : 0.0014791488647460938 time for calcul the mask position with numpy : 0.009781360626220703 nb_pixel_total : 4282 time to create 1 rle with old method : 0.004835367202758789 time for calcul the mask position with numpy : 0.009680032730102539 nb_pixel_total : 7 time to create 1 rle with old method : 3.0517578125e-05 time for calcul the mask position with numpy : 0.009669303894042969 nb_pixel_total : 6365 time to create 1 rle with old method : 0.006945371627807617 time for calcul the mask position with numpy : 0.009642601013183594 nb_pixel_total : 8621 time to create 1 rle with old method : 0.009538650512695312 time for calcul the mask position with numpy : 0.009866952896118164 nb_pixel_total : 122 time to create 1 rle with old method : 0.00016188621520996094 time for calcul the mask position with numpy : 0.00980377197265625 nb_pixel_total : 2770 time to create 1 rle with old method : 0.0033125877380371094 time for calcul the mask position with numpy : 0.009889364242553711 nb_pixel_total : 4622 time to create 1 rle with old method : 0.00529789924621582 time for calcul the mask position with numpy : 0.009555816650390625 nb_pixel_total : 8 time to create 1 rle with old method : 4.792213439941406e-05 time for calcul the mask position with numpy : 0.006796121597290039 nb_pixel_total : 852 time to create 1 rle with old method : 0.0009815692901611328 time for calcul the mask position with numpy : 0.005926609039306641 nb_pixel_total : 847 time to create 1 rle with old method : 0.0009102821350097656 time for calcul the mask position with numpy : 0.005976438522338867 nb_pixel_total : 3089 time to create 1 rle with old method : 0.003493070602416992 time for calcul the mask position with numpy : 0.00589299201965332 nb_pixel_total : 1393 time to create 1 rle with old method : 0.0015578269958496094 time for calcul the mask position with numpy : 0.005831003189086914 nb_pixel_total : 347 time to create 1 rle with old method : 0.00039696693420410156 time for calcul the mask position with numpy : 0.005936622619628906 nb_pixel_total : 93 time to create 1 rle with old method : 0.00017118453979492188 time for calcul the mask position with numpy : 0.005843162536621094 nb_pixel_total : 1639 time to create 1 rle with old method : 0.0017886161804199219 time for calcul the mask position with numpy : 0.005799293518066406 nb_pixel_total : 2068 time to create 1 rle with old method : 0.002402782440185547 time for calcul the mask position with numpy : 0.005915403366088867 nb_pixel_total : 147 time to create 1 rle with old method : 0.000194549560546875 time for calcul the mask position with numpy : 0.0057795047760009766 nb_pixel_total : 6496 time to create 1 rle with old method : 0.007164478302001953 time for calcul the mask position with numpy : 0.005964756011962891 nb_pixel_total : 677 time to create 1 rle with old method : 0.0007758140563964844 time for calcul the mask position with numpy : 0.005984783172607422 nb_pixel_total : 518 time to create 1 rle with old method : 0.0006072521209716797 time for calcul the mask position with numpy : 0.005934476852416992 nb_pixel_total : 3462 time to create 1 rle with old method : 0.005089759826660156 time for calcul the mask position with numpy : 0.006445646286010742 nb_pixel_total : 556 time to create 1 rle with old method : 0.0009539127349853516 time for calcul the mask position with numpy : 0.006372690200805664 nb_pixel_total : 247 time to create 1 rle with old method : 0.00040411949157714844 time for calcul the mask position with numpy : 0.006439924240112305 nb_pixel_total : 283 time to create 1 rle with old method : 0.0005178451538085938 time for calcul the mask position with numpy : 0.006407499313354492 nb_pixel_total : 202 time to create 1 rle with old method : 0.0004181861877441406 time for calcul the mask position with numpy : 0.006356477737426758 nb_pixel_total : 1521 time to create 1 rle with old method : 0.0024597644805908203 time for calcul the mask position with numpy : 0.006371259689331055 nb_pixel_total : 3588 time to create 1 rle with old method : 0.005654096603393555 time for calcul the mask position with numpy : 0.0063478946685791016 nb_pixel_total : 89 time to create 1 rle with old method : 0.0001614093780517578 time for calcul the mask position with numpy : 0.0063135623931884766 nb_pixel_total : 71 time to create 1 rle with old method : 0.00017762184143066406 time for calcul the mask position with numpy : 0.006407260894775391 nb_pixel_total : 405 time to create 1 rle with old method : 0.0006721019744873047 time for calcul the mask position with numpy : 0.0064542293548583984 nb_pixel_total : 2938 time to create 1 rle with old method : 0.004926919937133789 time for calcul the mask position with numpy : 0.006150722503662109 nb_pixel_total : 935 time to create 1 rle with old method : 0.00113677978515625 time for calcul the mask position with numpy : 0.006084442138671875 nb_pixel_total : 1169 time to create 1 rle with old method : 0.0013794898986816406 time for calcul the mask position with numpy : 0.006056070327758789 nb_pixel_total : 1783 time to create 1 rle with old method : 0.002076864242553711 time for calcul the mask position with numpy : 0.009391546249389648 nb_pixel_total : 487 time to create 1 rle with old method : 0.0005788803100585938 time for calcul the mask position with numpy : 0.00592041015625 nb_pixel_total : 8 time to create 1 rle with old method : 4.887580871582031e-05 time for calcul the mask position with numpy : 0.005875587463378906 nb_pixel_total : 1348 time to create 1 rle with old method : 0.0014233589172363281 time for calcul the mask position with numpy : 0.0059735774993896484 nb_pixel_total : 149 time to create 1 rle with old method : 0.00018358230590820312 time for calcul the mask position with numpy : 0.005988359451293945 nb_pixel_total : 208 time to create 1 rle with old method : 0.0002582073211669922 time for calcul the mask position with numpy : 0.005887508392333984 nb_pixel_total : 311 time to create 1 rle with old method : 0.00033354759216308594 time for calcul the mask position with numpy : 0.0066869258880615234 nb_pixel_total : 106064 time to create 1 rle with old method : 0.11238551139831543 time for calcul the mask position with numpy : 0.00622105598449707 nb_pixel_total : 3654 time to create 1 rle with old method : 0.003958225250244141 time for calcul the mask position with numpy : 0.005998373031616211 nb_pixel_total : 574 time to create 1 rle with old method : 0.0006241798400878906 time for calcul the mask position with numpy : 0.005837440490722656 nb_pixel_total : 1835 time to create 1 rle with old method : 0.0021049976348876953 time for calcul the mask position with numpy : 0.006036520004272461 nb_pixel_total : 325 time to create 1 rle with old method : 0.0005056858062744141 time for calcul the mask position with numpy : 0.006117105484008789 nb_pixel_total : 300 time to create 1 rle with old method : 0.00034117698669433594 time for calcul the mask position with numpy : 0.005948543548583984 nb_pixel_total : 49 time to create 1 rle with old method : 7.891654968261719e-05 time for calcul the mask position with numpy : 0.006020307540893555 nb_pixel_total : 29 time to create 1 rle with old method : 6.198883056640625e-05 time for calcul the mask position with numpy : 0.006099224090576172 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002288818359375 time for calcul the mask position with numpy : 0.0062656402587890625 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003285408020019531 time for calcul the mask position with numpy : 0.005952119827270508 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003135204315185547 time for calcul the mask position with numpy : 0.006005525588989258 nb_pixel_total : 805 time to create 1 rle with old method : 0.0009028911590576172 time for calcul the mask position with numpy : 0.00592803955078125 nb_pixel_total : 919 time to create 1 rle with old method : 0.0010569095611572266 time for calcul the mask position with numpy : 0.006813764572143555 nb_pixel_total : 1740 time to create 1 rle with old method : 0.0019636154174804688 time for calcul the mask position with numpy : 0.006118059158325195 nb_pixel_total : 283 time to create 1 rle with old method : 0.00034308433532714844 time for calcul the mask position with numpy : 0.00602412223815918 nb_pixel_total : 101 time to create 1 rle with old method : 0.00013709068298339844 time for calcul the mask position with numpy : 0.005994319915771484 nb_pixel_total : 2513 time to create 1 rle with old method : 0.002821207046508789 time for calcul the mask position with numpy : 0.0061228275299072266 nb_pixel_total : 25 time to create 1 rle with old method : 7.939338684082031e-05 time for calcul the mask position with numpy : 0.005973100662231445 nb_pixel_total : 207 time to create 1 rle with old method : 0.00024700164794921875 time for calcul the mask position with numpy : 0.006005525588989258 nb_pixel_total : 418 time to create 1 rle with old method : 0.0004930496215820312 time for calcul the mask position with numpy : 0.00596165657043457 nb_pixel_total : 5 time to create 1 rle with old method : 4.172325134277344e-05 time for calcul the mask position with numpy : 0.005994558334350586 nb_pixel_total : 441 time to create 1 rle with old method : 0.0005064010620117188 time for calcul the mask position with numpy : 0.00598907470703125 nb_pixel_total : 589 time to create 1 rle with old method : 0.0007030963897705078 time for calcul the mask position with numpy : 0.0059413909912109375 nb_pixel_total : 504 time to create 1 rle with old method : 0.0005638599395751953 time for calcul the mask position with numpy : 0.0060193538665771484 nb_pixel_total : 34 time to create 1 rle with old method : 6.794929504394531e-05 time for calcul the mask position with numpy : 0.005983114242553711 nb_pixel_total : 242 time to create 1 rle with old method : 0.0003151893615722656 time for calcul the mask position with numpy : 0.005991220474243164 nb_pixel_total : 1756 time to create 1 rle with old method : 0.0020830631256103516 time for calcul the mask position with numpy : 0.00587773323059082 nb_pixel_total : 59 time to create 1 rle with old method : 0.00012421607971191406 time for calcul the mask position with numpy : 0.006053924560546875 nb_pixel_total : 685 time to create 1 rle with old method : 0.0008008480072021484 time for calcul the mask position with numpy : 0.005998849868774414 nb_pixel_total : 1341 time to create 1 rle with old method : 0.0015878677368164062 time for calcul the mask position with numpy : 0.005973100662231445 nb_pixel_total : 820 time to create 1 rle with old method : 0.0009138584136962891 time for calcul the mask position with numpy : 0.006083488464355469 nb_pixel_total : 107 time to create 1 rle with old method : 0.00014448165893554688 time for calcul the mask position with numpy : 0.0060214996337890625 nb_pixel_total : 357 time to create 1 rle with old method : 0.000446319580078125 time for calcul the mask position with numpy : 0.006074190139770508 nb_pixel_total : 37 time to create 1 rle with old method : 7.724761962890625e-05 time for calcul the mask position with numpy : 0.006012916564941406 nb_pixel_total : 648 time to create 1 rle with old method : 0.000766754150390625 time for calcul the mask position with numpy : 0.006094932556152344 nb_pixel_total : 827 time to create 1 rle with old method : 0.0009779930114746094 time for calcul the mask position with numpy : 0.0060083866119384766 nb_pixel_total : 1020 time to create 1 rle with old method : 0.0011827945709228516 time for calcul the mask position with numpy : 0.006089687347412109 nb_pixel_total : 71 time to create 1 rle with old method : 0.000102996826171875 time for calcul the mask position with numpy : 0.00605010986328125 nb_pixel_total : 856 time to create 1 rle with old method : 0.0010271072387695312 time for calcul the mask position with numpy : 0.006156444549560547 nb_pixel_total : 63 time to create 1 rle with old method : 9.846687316894531e-05 time for calcul the mask position with numpy : 0.0061419010162353516 nb_pixel_total : 378 time to create 1 rle with old method : 0.0004324913024902344 time for calcul the mask position with numpy : 0.006117820739746094 nb_pixel_total : 26 time to create 1 rle with old method : 7.081031799316406e-05 time for calcul the mask position with numpy : 0.006102323532104492 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002396106719970703 time for calcul the mask position with numpy : 0.005792856216430664 nb_pixel_total : 315 time to create 1 rle with old method : 0.0003914833068847656 time for calcul the mask position with numpy : 0.005903482437133789 nb_pixel_total : 122 time to create 1 rle with old method : 0.00016951560974121094 time for calcul the mask position with numpy : 0.005949974060058594 nb_pixel_total : 2551 time to create 1 rle with old method : 0.002760171890258789 time for calcul the mask position with numpy : 0.005917549133300781 nb_pixel_total : 787 time to create 1 rle with old method : 0.0008933544158935547 time for calcul the mask position with numpy : 0.0060579776763916016 nb_pixel_total : 229 time to create 1 rle with old method : 0.0003352165222167969 time for calcul the mask position with numpy : 0.005820274353027344 nb_pixel_total : 1303 time to create 1 rle with old method : 0.0013885498046875 time for calcul the mask position with numpy : 0.0060727596282958984 nb_pixel_total : 480 time to create 1 rle with old method : 0.0005681514739990234 time for calcul the mask position with numpy : 0.0059986114501953125 nb_pixel_total : 223 time to create 1 rle with old method : 0.0002696514129638672 time for calcul the mask position with numpy : 0.0058977603912353516 nb_pixel_total : 269 time to create 1 rle with old method : 0.0003256797790527344 time for calcul the mask position with numpy : 0.006009101867675781 nb_pixel_total : 212 time to create 1 rle with old method : 0.0002582073211669922 time for calcul the mask position with numpy : 0.00602412223815918 nb_pixel_total : 453 time to create 1 rle with old method : 0.0005199909210205078 time for calcul the mask position with numpy : 0.005949258804321289 nb_pixel_total : 157 time to create 1 rle with old method : 0.00020003318786621094 time for calcul the mask position with numpy : 0.005966901779174805 nb_pixel_total : 316 time to create 1 rle with old method : 0.0003886222839355469 time for calcul the mask position with numpy : 0.005959272384643555 nb_pixel_total : 1189 time to create 1 rle with old method : 0.0013766288757324219 time for calcul the mask position with numpy : 0.0062198638916015625 nb_pixel_total : 662 time to create 1 rle with old method : 0.0007612705230712891 time for calcul the mask position with numpy : 0.005983114242553711 nb_pixel_total : 208 time to create 1 rle with old method : 0.0002617835998535156 time for calcul the mask position with numpy : 0.005864143371582031 nb_pixel_total : 36 time to create 1 rle with old method : 5.8650970458984375e-05 time for calcul the mask position with numpy : 0.006081104278564453 nb_pixel_total : 765 time to create 1 rle with old method : 0.0008871555328369141 time for calcul the mask position with numpy : 0.005835294723510742 nb_pixel_total : 886 time to create 1 rle with old method : 0.0010466575622558594 time for calcul the mask position with numpy : 0.0058209896087646484 nb_pixel_total : 164 time to create 1 rle with old method : 0.00019073486328125 time for calcul the mask position with numpy : 0.005901336669921875 nb_pixel_total : 151 time to create 1 rle with old method : 0.00019288063049316406 time for calcul the mask position with numpy : 0.005968332290649414 nb_pixel_total : 347 time to create 1 rle with old method : 0.00041747093200683594 time for calcul the mask position with numpy : 0.005982160568237305 nb_pixel_total : 3967 time to create 1 rle with old method : 0.00433659553527832 time for calcul the mask position with numpy : 0.005750894546508789 nb_pixel_total : 6 time to create 1 rle with old method : 2.9802322387695312e-05 time for calcul the mask position with numpy : 0.0059397220611572266 nb_pixel_total : 288 time to create 1 rle with old method : 0.0003256797790527344 time for calcul the mask position with numpy : 0.005803346633911133 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002624988555908203 time for calcul the mask position with numpy : 0.005820274353027344 nb_pixel_total : 1574 time to create 1 rle with old method : 0.0016336441040039062 time for calcul the mask position with numpy : 0.005922079086303711 nb_pixel_total : 15 time to create 1 rle with old method : 3.600120544433594e-05 time for calcul the mask position with numpy : 0.0059070587158203125 nb_pixel_total : 1342 time to create 1 rle with old method : 0.0015609264373779297 time for calcul the mask position with numpy : 0.005808830261230469 nb_pixel_total : 141 time to create 1 rle with old method : 0.00015974044799804688 time for calcul the mask position with numpy : 0.005934238433837891 nb_pixel_total : 351 time to create 1 rle with old method : 0.00042366981506347656 time for calcul the mask position with numpy : 0.006066083908081055 nb_pixel_total : 312 time to create 1 rle with old method : 0.00037288665771484375 time for calcul the mask position with numpy : 0.00592494010925293 nb_pixel_total : 551 time to create 1 rle with old method : 0.0005922317504882812 time for calcul the mask position with numpy : 0.005921363830566406 nb_pixel_total : 408 time to create 1 rle with old method : 0.00048732757568359375 time for calcul the mask position with numpy : 0.0059070587158203125 nb_pixel_total : 887 time to create 1 rle with old method : 0.0009551048278808594 time for calcul the mask position with numpy : 0.005831480026245117 nb_pixel_total : 370 time to create 1 rle with old method : 0.0004267692565917969 time for calcul the mask position with numpy : 0.006062507629394531 nb_pixel_total : 43 time to create 1 rle with old method : 0.0001595020294189453 time for calcul the mask position with numpy : 0.006040811538696289 nb_pixel_total : 1193 time to create 1 rle with old method : 0.0013229846954345703 time for calcul the mask position with numpy : 0.0061991214752197266 nb_pixel_total : 113 time to create 1 rle with old method : 0.00014901161193847656 time for calcul the mask position with numpy : 0.0059392452239990234 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005438327789306641 time for calcul the mask position with numpy : 0.00638580322265625 nb_pixel_total : 2170 time to create 1 rle with old method : 0.0023508071899414062 time for calcul the mask position with numpy : 0.005957126617431641 nb_pixel_total : 564 time to create 1 rle with old method : 0.0005788803100585938 time for calcul the mask position with numpy : 0.006007671356201172 nb_pixel_total : 401 time to create 1 rle with old method : 0.00047206878662109375 time for calcul the mask position with numpy : 0.006013393402099609 nb_pixel_total : 299 time to create 1 rle with old method : 0.0003561973571777344 time for calcul the mask position with numpy : 0.005927562713623047 nb_pixel_total : 11 time to create 1 rle with old method : 3.600120544433594e-05 time for calcul the mask position with numpy : 0.005980968475341797 nb_pixel_total : 340 time to create 1 rle with old method : 0.0004019737243652344 time for calcul the mask position with numpy : 0.0058820247650146484 nb_pixel_total : 311 time to create 1 rle with old method : 0.00036144256591796875 time for calcul the mask position with numpy : 0.0060269832611083984 nb_pixel_total : 7 time to create 1 rle with old method : 4.172325134277344e-05 time for calcul the mask position with numpy : 0.0058612823486328125 nb_pixel_total : 218 time to create 1 rle with old method : 0.00026988983154296875 time for calcul the mask position with numpy : 0.00587773323059082 nb_pixel_total : 126 time to create 1 rle with old method : 0.00015616416931152344 create new chi : 1.5455594062805176 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0016994476318359375 batch 1 Loaded 161 chid ids of type : 4230 Number RLEs to save : 14353 TO DO : save crop sub photo not yet done ! save time : 2.200843572616577 map_output_result : {1337667504: (0.0, 'Should be the crop_list due to order', 0.0), 1337667471: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1337667504, 1337667471] Looping around the photos to save general results len do output : 2 /1337667504.Didn't retrieve data . /1337667471.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588613') ('4234', '20567470', '1337667504', None, None, None, None, None, '2588613') ('4234', None, None, None, None, None, None, None, '2588613') ('4234', '20567470', '1337667471', None, None, None, None, None, '2588613') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.012578725814819336 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.276575803756714 time spend to save output : 0.012805938720703125 total time spend for step 4 : 11.289381742477417 step5:crop_condition Sat Feb 15 10:21:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 2 ! batch 1 Loaded 326 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 101 About to insert : list_path_to_insert length 101 new photo from crops ! About to upload 101 photos upload in portfolio : 4869462 init cache_photo without model_param we have 101 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739611269_501992 we have uploaded 101 photos in the portfolio 4869462 time of upload the photos Elapsed time : 35.050278186798096 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 36 About to insert : list_path_to_insert length 36 new photo from crops ! About to upload 36 photos upload in portfolio : 4869462 init cache_photo without model_param we have 36 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739611305_501992 we have uploaded 36 photos in the portfolio 4869462 time of upload the photos Elapsed time : 9.406180381774902 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739611315_501992 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.7415924072265625 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 4869462 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739611316_501992 we have uploaded 15 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.5703954696655273 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 52 About to insert : list_path_to_insert length 52 new photo from crops ! About to upload 52 photos upload in portfolio : 4869462 init cache_photo without model_param we have 52 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739611320_501992 we have uploaded 52 photos in the portfolio 4869462 time of upload the photos Elapsed time : 11.537163496017456 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1337667504, 1337667471] Looping around the photos to save general results len do output : 206 /1337859207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337859428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588613') ('4234', '20567470', '1337667504', None, None, None, None, None, '2588613') ('4234', None, None, None, None, None, None, None, '2588613') ('4234', '20567470', '1337667471', None, None, None, None, None, '2588613') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 620 time used for this insertion : 0.03744316101074219 save_final save missing photos in datou_result : time spend for datou_step_exec : 63.88990235328674 time spend to save output : 0.042867183685302734 total time spend for step 5 : 63.932769536972046 step6:thcl Sat Feb 15 10:22:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.008724451065063477 time to convert the images to numpy array : 0.040505170822143555 time to import caffe and check if the image exist : 0.008128166198730469 time to convert the images to numpy array : 0.047818660736083984 time to import caffe and check if the image exist : 0.010659456253051758 time to convert the images to numpy array : 0.04825568199157715 time to import caffe and check if the image exist : 0.019735336303710938 time to convert the images to numpy array : 0.04164481163024902 time to import caffe and check if the image exist : 0.009347200393676758 time to convert the images to numpy array : 0.05365419387817383 time to import caffe and check if the image exist : 0.017793893814086914 time to convert the images to numpy array : 0.04585909843444824 time to import caffe and check if the image exist : 0.01689291000366211 time to convert the images to numpy array : 0.048976898193359375 time to import caffe and check if the image exist : 0.013332605361938477 time to convert the images to numpy array : 0.053525686264038086 time to import caffe and check if the image exist : 0.017763376235961914 time to convert the images to numpy array : 0.04970836639404297 time to import caffe and check if the image exist : 0.016911029815673828 time to convert the images to numpy array : 0.05104255676269531 total time to convert the images to numpy array : 0.28032350540161133 list photo_ids error: [] list photo_ids correct : [1337859412, 1337859413, 1337859414, 1337859415, 1337859416, 1337859417, 1337859418, 1337859419, 1337859420, 1337859421, 1337859422, 1337859423, 1337859424, 1337859425, 1337859426, 1337859427, 1337859428, 1337859321, 1337859322, 1337859323, 1337859324, 1337859325, 1337859326, 1337859327, 1337859328, 1337859329, 1337859330, 1337859331, 1337859332, 1337859333, 1337859334, 1337859335, 1337859336, 1337859337, 1337859339, 1337859340, 1337859341, 1337859343, 1337859294, 1337859295, 1337859296, 1337859297, 1337859298, 1337859299, 1337859300, 1337859301, 1337859302, 1337859303, 1337859304, 1337859305, 1337859306, 1337859307, 1337859308, 1337859309, 1337859310, 1337859317, 1337859318, 1337859319, 1337859320, 1337859228, 1337859229, 1337859230, 1337859231, 1337859232, 1337859233, 1337859234, 1337859235, 1337859236, 1337859237, 1337859238, 1337859239, 1337859240, 1337859241, 1337859242, 1337859243, 1337859244, 1337859245, 1337859246, 1337859247, 1337859248, 1337859368, 1337859369, 1337859370, 1337859371, 1337859372, 1337859373, 1337859374, 1337859377, 1337859378, 1337859379, 1337859380, 1337859381, 1337859382, 1337859383, 1337859384, 1337859385, 1337859386, 1337859387, 1337859388, 1337859389, 1337859390, 1337859391, 1337859392, 1337859393, 1337859394, 1337859395, 1337859396, 1337859397, 1337859398, 1337859399, 1337859400, 1337859401, 1337859402, 1337859403, 1337859404, 1337859405, 1337859406, 1337859407, 1337859408, 1337859409, 1337859410, 1337859411, 1337859344, 1337859345, 1337859346, 1337859347, 1337859348, 1337859349, 1337859350, 1337859351, 1337859352, 1337859353, 1337859354, 1337859356, 1337859357, 1337859359, 1337859360, 1337859361, 1337859362, 1337859363, 1337859364, 1337859365, 1337859367, 1337859273, 1337859274, 1337859275, 1337859276, 1337859277, 1337859278, 1337859279, 1337859280, 1337859281, 1337859282, 1337859283, 1337859284, 1337859285, 1337859286, 1337859287, 1337859288, 1337859289, 1337859290, 1337859291, 1337859292, 1337859293, 1337859207, 1337859208, 1337859209, 1337859210, 1337859211, 1337859212, 1337859213, 1337859214, 1337859215, 1337859216, 1337859217, 1337859218, 1337859219, 1337859220, 1337859221, 1337859222, 1337859223, 1337859224, 1337859225, 1337859226, 1337859227, 1337859249, 1337859250, 1337859251, 1337859252, 1337859253, 1337859254, 1337859255, 1337859256, 1337859257, 1337859258, 1337859259, 1337859260, 1337859261, 1337859262, 1337859263, 1337859264, 1337859265, 1337859266, 1337859267, 1337859268, 1337859272] number of photos to traite : 206 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10555 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 0.9547288417816162 time used to do the prediction : 0.7870635986328125 save descriptor for thcl : 3237 time to traite the descriptors : 1.1175389289855957 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1337859412 To insert : 1337859413 To insert : 1337859414 To insert : 1337859415 To insert : 1337859416 To insert : 1337859417 To insert : 1337859418 To insert : 1337859419 To insert : 1337859420 To insert : 1337859421 To insert : 1337859422 To insert : 1337859423 To insert : 1337859424 To insert : 1337859425 To insert : 1337859426 To insert : 1337859427 To insert : 1337859428 To insert : 1337859321 To insert : 1337859322 To insert : 1337859323 To insert : 1337859324 To insert : 1337859325 To insert : 1337859326 To insert : 1337859327 To insert : 1337859328 To insert : 1337859329 To insert : 1337859330 To insert : 1337859331 To insert : 1337859332 To insert : 1337859333 To insert : 1337859334 To insert : 1337859335 To insert : 1337859336 To insert : 1337859337 To insert : 1337859339 To insert : 1337859340 To insert : 1337859341 To insert : 1337859343 To insert : 1337859294 To insert : 1337859295 To insert : 1337859296 To insert : 1337859297 To insert : 1337859298 To insert : 1337859299 To insert : 1337859300 To insert : 1337859301 To insert : 1337859302 To insert : 1337859303 To insert : 1337859304 To insert : 1337859305 To insert : 1337859306 To insert : 1337859307 To insert : 1337859308 To insert : 1337859309 To insert : 1337859310 To insert : 1337859317 To insert : 1337859318 To insert : 1337859319 To insert : 1337859320 To insert : 1337859228 To insert : 1337859229 To insert : 1337859230 To insert : 1337859231 To insert : 1337859232 To insert : 1337859233 To insert : 1337859234 To insert : 1337859235 To insert : 1337859236 To insert : 1337859237 To insert : 1337859238 To insert : 1337859239 To insert : 1337859240 To insert : 1337859241 To insert : 1337859242 To insert : 1337859243 To insert : 1337859244 To insert : 1337859245 To insert : 1337859246 To insert : 1337859247 To insert : 1337859248 To insert : 1337859368 To insert : 1337859369 To insert : 1337859370 To insert : 1337859371 To insert : 1337859372 To insert : 1337859373 To insert : 1337859374 To insert : 1337859377 To insert : 1337859378 To insert : 1337859379 To insert : 1337859380 To insert : 1337859381 To insert : 1337859382 To insert : 1337859383 To insert : 1337859384 To insert : 1337859385 To insert : 1337859386 To insert : 1337859387 To insert : 1337859388 To insert : 1337859389 To insert : 1337859390 To insert : 1337859391 To insert : 1337859392 To insert : 1337859393 To insert : 1337859394 To insert : 1337859395 To insert : 1337859396 To insert : 1337859397 To insert : 1337859398 To insert : 1337859399 To insert : 1337859400 To insert : 1337859401 To insert : 1337859402 To insert : 1337859403 To insert : 1337859404 To insert : 1337859405 To insert : 1337859406 To insert : 1337859407 To insert : 1337859408 To insert : 1337859409 To insert : 1337859410 To insert : 1337859411 To insert : 1337859344 To insert : 1337859345 To insert : 1337859346 To insert : 1337859347 To insert : 1337859348 To insert : 1337859349 To insert : 1337859350 To insert : 1337859351 To insert : 1337859352 To insert : 1337859353 To insert : 1337859354 To insert : 1337859356 To insert : 1337859357 To insert : 1337859359 To insert : 1337859360 To insert : 1337859361 To insert : 1337859362 To insert : 1337859363 To insert : 1337859364 To insert : 1337859365 To insert : 1337859367 To insert : 1337859273 To insert : 1337859274 To insert : 1337859275 To insert : 1337859276 To insert : 1337859277 To insert : 1337859278 To insert : 1337859279 To insert : 1337859280 To insert : 1337859281 To insert : 1337859282 To insert : 1337859283 To insert : 1337859284 To insert : 1337859285 To insert : 1337859286 To insert : 1337859287 To insert : 1337859288 To insert : 1337859289 To insert : 1337859290 To insert : 1337859291 To insert : 1337859292 To insert : 1337859293 To insert : 1337859207 To insert : 1337859208 To insert : 1337859209 To insert : 1337859210 To insert : 1337859211 To insert : 1337859212 To insert : 1337859213 To insert : 1337859214 To insert : 1337859215 To insert : 1337859216 To insert : 1337859217 To insert : 1337859218 To insert : 1337859219 To insert : 1337859220 To insert : 1337859221 To insert : 1337859222 To insert : 1337859223 To insert : 1337859224 To insert : 1337859225 To insert : 1337859226 To insert : 1337859227 To insert : 1337859249 To insert : 1337859250 To insert : 1337859251 To insert : 1337859252 To insert : 1337859253 To insert : 1337859254 To insert : 1337859255 To insert : 1337859256 To insert : 1337859257 To insert : 1337859258 To insert : 1337859259 To insert : 1337859260 To insert : 1337859261 To insert : 1337859262 To insert : 1337859263 To insert : 1337859264 To insert : 1337859265 To insert : 1337859266 To insert : 1337859267 To insert : 1337859268 To insert : 1337859272 time to insert the descriptors : 35.68326926231384 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 329 time used for this insertion : 0.027551889419555664 save missing photos in datou_result : time spend for datou_step_exec : 42.69245433807373 time spend to save output : 0.08937239646911621 total time spend for step 6 : 42.78182673454285 step7:ventilate_hashtags_in_portfolio Sat Feb 15 10:22:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20567470 get user id for portfolio 20567470 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567470 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','Carton','metal','pehd','pet_clair','carton','mal_croppe','Film_plastique','pet_fonce','autre','PET_fonce','Papier','Tetrapak','PEHD','refus','PET_clair','flou','papier')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567470 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','Carton','metal','pehd','pet_clair','carton','mal_croppe','Film_plastique','pet_fonce','autre','PET_fonce','Papier','Tetrapak','PEHD','refus','PET_clair','flou','papier')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567470 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','Carton','metal','pehd','pet_clair','carton','mal_croppe','Film_plastique','pet_fonce','autre','PET_fonce','Papier','Tetrapak','PEHD','refus','PET_clair','flou','papier')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567470 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','Carton','metal','pehd','pet_clair','carton','mal_croppe','Film_plastique','pet_fonce','autre','PET_fonce','Papier','Tetrapak','PEHD','refus','PET_clair','flou','papier')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20585217,20585222,20585219,20585230,20585232,20585223,20585224,20585227,20585226,20585234,20585229,20585231,20585233?tags=environnement,carton,metal,pehd,pet_clair,mal_croppe,film_plastique,pet_fonce,autre,papier,tetrapak,refus,flou&datou_id_consolidate=4235&port_consolidate=20567470 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1337667504, 1337667471] Looping around the photos to save general results len do output : 1 /20567470. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588613') ('4234', '20567470', '1337667504', None, None, None, None, None, '2588613') ('4234', None, None, None, None, None, None, None, '2588613') ('4234', '20567470', '1337667471', None, None, None, None, None, '2588613') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.013127326965332031 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.2757527828216553 time spend to save output : 0.0134124755859375 total time spend for step 7 : 2.2891652584075928 step8:final Sat Feb 15 10:22:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1337667504: ('0.2402249268024326',), 1337667471: ('0.2402249268024326',)} new output for save of step final : {1337667504: ('0.2402249268024326',), 1337667471: ('0.2402249268024326',)} [1337667504, 1337667471] Looping around the photos to save general results len do output : 2 /1337667504.Didn't retrieve data . /1337667471.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588613') ('4234', '20567470', '1337667504', None, None, None, None, None, '2588613') ('4234', None, None, None, None, None, None, None, '2588613') ('4234', '20567470', '1337667471', None, None, None, None, None, '2588613') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.011775732040405273 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1134490966796875 time spend to save output : 0.011923789978027344 total time spend for step 8 : 0.12537288665771484 step9:velours_tree Sat Feb 15 10:22:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20585217,20585222,20585219,20585230,20585232,20585223,20585224,20585227,20585226,20585234,20585229,20585231,20585233 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585217 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585222 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585219 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585230 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585232 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585223 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585224 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585227 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585226 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585234 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585229 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585231 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20585233 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 206 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [0 0 0 4 4 0 4 4 4 4 2 3 3 4 4 3 0 0 2 3 0 0 1 1 3 4 3 0 1 3 0 3 3 1 3 1 3 1 1 1 1 4 1 1 0 0 4 0 1 0 1 3 1 3 3 0 0 4 4 4 0 4 4 4 2 3 4 3 3 2 3 0 0 2 1 1 4 1 3 3 4 1 3 1 3 3 3 1 1 4 1 1 0 0 0 3 1 0 1 0 0 5 1 0 1 1 4 0 3 1 3 3 3 3 3 3 1 4 1 4 1 3 0 5 4 1 3 1 4 3 3 3 0 4 4 0 3 1 1 3 0 3 3 2 0 4 1 4 4 3 3 0 1 4 0 5 5 1 0 4 3 0 3 1 1 1 1 1 1 1 1 0 0 0 0 3 1 0 1 0 5 5 1 4 0 3 0 3 1 3 1 1 1 1 3 1 1 0 1 0 0 0 0 3 0 3] Elapsed time: 0.03133249282836914 graph_id used : 78857 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20585217,20585222,20585219,20585230,20585232,20585223,20585224,20585227,20585226,20585234,20585229,20585231,20585233?tags=environnement,carton,metal,pehd,pet_clair,mal_croppe,film_plastique,pet_fonce,autre,papier,tetrapak,refus,flou&datou_id_consolidate=4235&port_consolidate=20567470&tree_id=78857 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1337667504, 1337667471] Looping around the photos to save general results len do output : 1 /20567470Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588613') ('4234', '20567470', '1337667504', None, None, None, None, None, '2588613') ('4234', None, None, None, None, None, None, None, '2588613') ('4234', '20567470', '1337667471', None, None, None, None, None, '2588613') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.012300968170166016 save_final save missing photos in datou_result : time spend for datou_step_exec : 13.741178035736084 time spend to save output : 0.012514352798461914 total time spend for step 9 : 13.753692388534546 step10:send_mail_cod Sat Feb 15 10:23:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20567470_15-02-2025_10_23_10.pdf 20585204 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205852041739611390 20585201 change filename to text .change filename to text .imagette205852011739611391 20585212 imagette205852121739611392 20585214 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205852141739611392 20585205 imagette205852051739611392 20585206 imagette205852061739611392 20585209 imagette205852091739611392 20585208 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205852081739611392 20585216 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205852161739611393 20585211 imagette205852111739611394 20585213 imagette205852131739611394 20585215 imagette205852151739611394 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20567470 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20585217,20585222,20585219,20585230,20585232,20585223,20585224,20585227,20585226,20585234,20585229,20585231,20585233?tags=environnement,carton,metal,pehd,pet_clair,mal_croppe,film_plastique,pet_fonce,autre,papier,tetrapak,refus,flou&datou_id_consolidate=4235&port_consolidate=20567470&tree_id=78857 your option no_mail is active, we will not send the real mail to your client args[1337667504] : ((1337667504, -7.7533077717949315, 492609224), (1337667504, -0.48591584685162087, 501862349), '0.2402249268024326') apple ((1337667504, -7.7533077717949315, 492609224), (1337667504, -0.48591584685162087, 501862349), '0.2402249268024326') We are sending mail with results at cod@fotonower.com args[1337667471] : ((1337667471, -7.756930965779299, 492609224), (1337667471, -0.47983884689792056, 496442774), '0.2402249268024326') apple ((1337667471, -7.756930965779299, 492609224), (1337667471, -0.47983884689792056, 496442774), '0.2402249268024326') We are sending mail with results at cod@fotonower.com refus_total : 0.2402249268024326 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20567470 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567470_15-02-2025_10_23_10.pdf results_Qualipapia_P20567470_15-02-2025_10_23_10.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567470_15-02-2025_10_23_10.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20567470','results_Qualipapia_P20567470_15-02-2025_10_23_10.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567470_15-02-2025_10_23_10.pdf','pdf','','0.16','0.2402249268024326') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1337667504, 1337667471] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588613') ('4234', '20567470', '1337667504', None, None, None, None, None, '2588613') ('4234', None, None, None, None, None, None, None, '2588613') ('4234', '20567470', '1337667471', None, None, None, None, None, '2588613') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.05928516387939453 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.841397285461426 time spend to save output : 0.05942416191101074 total time spend for step 10 : 4.9008214473724365 step11:split_time_score Sat Feb 15 10:23:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 2),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 14022025 20567470 Nombre de photos uploadées : 2 / 23040 (0%) 14022025 20567470 Nombre de photos taguées (types de déchets): 2 / 2 (100%) 14022025 20567470 Nombre de photos taguées (volume) : 0 / 2 (0%) elapsed_time : load_data_split_time_score 4.0531158447265625e-06 elapsed_time : order_list_meta_photo_and_scores 8.821487426757812e-06 ?? elapsed_time : fill_and_build_computed_from_old_data 0.00023484230041503906 elapsed_time : insert_dashboard_record_day_entry 0.02352619171142578 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.14080265003567735 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20557267_14-02-2025_13_16_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20557267 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20557267 AND mptpi.`type`=4230 To do Qualite : 0.16283505865355488 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20557268_14-02-2025_13_06_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20557268 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20557268 AND mptpi.`type`=4230 To do Qualite : 0.12385820099779768 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20578763_15-02-2025_00_23_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20578763 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20578763 AND mptpi.`type`=4230 To do Qualite : 0.17080943635979126 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20561437_14-02-2025_16_47_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20561437 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20561437 AND mptpi.`type`=4230 To do Qualite : 0.15705737530364391 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20561438_14-02-2025_16_22_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20561438 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20561438 AND mptpi.`type`=4230 To do Qualite : 0.24123338678301143 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20561439_14-02-2025_16_36_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20561439 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20561439 AND mptpi.`type`=4230 To do Qualite : 0.2278315065084019 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20561440_14-02-2025_15_49_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20561440 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20561440 AND mptpi.`type`=4230 To do Qualite : 0.21292784892651612 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20577017_14-02-2025_22_03_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20577017 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20577017 AND mptpi.`type`=4230 To do Qualite : 0.21228317775297423 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20565004_14-02-2025_17_33_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20565004 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20565004 AND mptpi.`type`=4230 To do Qualite : 0.18492439423286242 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20565005_15-02-2025_09_58_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20565005 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20565005 AND mptpi.`type`=4230 To do Qualite : 0.23082729524202808 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20565006_15-02-2025_10_03_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20565006 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20565006 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20565007 order by id desc limit 1 Qualite : 0.2534233030896306 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568568_15-02-2025_08_54_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568568 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568568 AND mptpi.`type`=4230 To do Qualite : 0.2588671757087973 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568570_15-02-2025_05_39_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568570 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568570 AND mptpi.`type`=4230 To do Qualite : 0.25108773598537126 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568571_15-02-2025_04_03_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568571 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568571 AND mptpi.`type`=4230 To do Qualite : 0.20697733701802679 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568572_15-02-2025_04_38_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568572 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568572 AND mptpi.`type`=4230 To do Qualite : 0.21802253677162223 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568575_15-02-2025_02_47_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568575 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568575 AND mptpi.`type`=4230 To do Qualite : 0.2522388465777581 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568587_15-02-2025_02_33_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568587 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568587 AND mptpi.`type`=4230 To do Qualite : 0.25095045419947665 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568601_15-02-2025_01_56_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568601 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568601 AND mptpi.`type`=4230 To do Qualite : 0.2392819042405134 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568602_15-02-2025_03_43_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568602 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568602 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567453 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567454 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567455 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567456 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567457 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567458 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567459 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567460 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567461 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567462 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567463 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567464 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567465 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567466 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567467 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567468 order by id desc limit 1 Qualite : 0.28963136597642414 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567469_15-02-2025_09_32_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567469 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567469 AND mptpi.`type`=4230 To do Qualite : 0.2402249268024326 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567470_15-02-2025_10_23_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567470 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567470 AND mptpi.`type`=4230 To do Qualite : 0.22081808196868286 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567471_15-02-2025_09_48_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567471 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567471 AND mptpi.`type`=4230 To do Qualite : 0.24312637283776384 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567472_15-02-2025_07_47_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567472 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567472 AND mptpi.`type`=4230 To do Qualite : 0.20139709657864976 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567473_15-02-2025_09_17_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567473 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567473 AND mptpi.`type`=4230 To do Qualite : 0.204046268666926 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567474_15-02-2025_06_23_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567474 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567474 AND mptpi.`type`=4230 To do Qualite : 0.18417908255302992 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567475_15-02-2025_06_47_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567475 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567475 AND mptpi.`type`=4230 To do Qualite : 0.21982992715830277 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567476_15-02-2025_06_17_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567476 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567476 AND mptpi.`type`=4230 To do Qualite : 0.30472788576123255 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567477_15-02-2025_05_47_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567477 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567477 AND mptpi.`type`=4230 To do Qualite : 0.23699891677009535 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567478_14-02-2025_18_34_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567478 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567478 AND mptpi.`type`=4230 To do Qualite : 0.2659324169831625 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567479_14-02-2025_18_20_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567479 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567479 AND mptpi.`type`=4230 To do Qualite : 0.23264297907652698 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567480_14-02-2025_18_23_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567480 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567480 AND mptpi.`type`=4230 To do Qualite : 0.2402551151372868 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568604_15-02-2025_00_48_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568604 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568604 AND mptpi.`type`=4230 To do Qualite : 0.22023519577147693 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568605_14-02-2025_23_48_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568605 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568605 AND mptpi.`type`=4230 To do Qualite : 0.26055813790983423 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568606_15-02-2025_00_34_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568606 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568606 AND mptpi.`type`=4230 To do Qualite : 0.25440762275141415 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568607_14-02-2025_20_23_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568607 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568607 AND mptpi.`type`=4230 To do Qualite : 0.23908227128633877 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568608_14-02-2025_20_21_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568608 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568608 AND mptpi.`type`=4230 To do Qualite : 0.25379507447780547 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568609_14-02-2025_18_47_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568609 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568609 AND mptpi.`type`=4230 To do Qualite : 0.255508684248806 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568610_14-02-2025_19_35_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568610 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568610 AND mptpi.`type`=4230 To do Qualite : 0.24818222150458366 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568611_14-02-2025_20_34_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568611 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568611 AND mptpi.`type`=4230 To do Qualite : 0.2428419785256863 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568612_14-02-2025_18_37_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568612 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568612 AND mptpi.`type`=4230 To do Qualite : 0.2477337637088999 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20571465_14-02-2025_19_47_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20571465 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20571465 AND mptpi.`type`=4230 To do Qualite : 0.23064257970638882 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20576591_14-02-2025_22_45_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20576591 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20576591 AND mptpi.`type`=4230 To do Qualite : 0.21982307840160847 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20576592_14-02-2025_23_29_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20576592 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20576592 AND mptpi.`type`=4230 To do Qualite : 0.21935584026591903 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20575968_14-02-2025_23_32_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20575968 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20575968 AND mptpi.`type`=4230 To do Qualite : 0.20981345687102668 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20575969_14-02-2025_21_19_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20575969 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20575969 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'14022025': {'nb_upload': 2, 'nb_taggue_class': 2, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1337667504, 1337667471] Looping around the photos to save general results len do output : 1 /20567470Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588613') ('4234', '20567470', '1337667504', None, None, None, None, None, '2588613') ('4234', None, None, None, None, None, None, None, '2588613') ('4234', '20567470', '1337667471', None, None, None, None, None, '2588613') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.01332235336303711 save_final save missing photos in datou_result : time spend for datou_step_exec : 16.19270420074463 time spend to save output : 0.01349329948425293 total time spend for step 11 : 16.206197500228882 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 2 set_done_treatment 35.18user 23.32system 3:06.56elapsed 31%CPU (0avgtext+0avgdata 3122656maxresident)k 491592inputs+14928outputs (162major+2665369minor)pagefaults 0swaps