python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2060708 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2560841'] with mtr_portfolio_ids : ['20313888'] and first list_photo_ids : [] new path : /proc/2060708/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 2 ; length of list_pids : 2 ; length of list_args : 2 time to download the photos : 0.2640557289123535 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Fri Feb 7 06:20:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4023 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-07 06:20:31.544642: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-07 06:20:31.571116: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-07 06:20:31.573245: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f63dc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-07 06:20:31.573276: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-07 06:20:31.577299: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-07 06:20:31.829872: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x977f040 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-07 06:20:31.829923: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-07 06:20:31.831034: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-07 06:20:31.831752: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-07 06:20:31.836234: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-07 06:20:31.839356: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-07 06:20:31.840243: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-07 06:20:31.843112: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-07 06:20:31.844424: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-07 06:20:31.849957: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-07 06:20:31.851402: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-07 06:20:31.851498: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-07 06:20:31.852186: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-07 06:20:31.852202: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-07 06:20:31.852211: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-07 06:20:31.853187: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3571 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-07 06:20:32.115449: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-07 06:20:32.115592: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-07 06:20:32.116359: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-07 06:20:32.116407: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-07 06:20:32.116436: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-07 06:20:32.116454: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-07 06:20:32.116472: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-07 06:20:32.116490: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-07 06:20:32.117585: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-07 06:20:32.118660: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-07 06:20:32.118702: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-07 06:20:32.118725: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-07 06:20:32.118745: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-07 06:20:32.118765: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-07 06:20:32.118784: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-07 06:20:32.118803: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-07 06:20:32.118823: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-07 06:20:32.119918: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-07 06:20:32.119953: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-07 06:20:32.119963: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-07 06:20:32.119973: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-07 06:20:32.121087: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3571 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-07 06:20:42.389113: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-07 06:20:42.603383: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-07 06:20:44.311425: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.312084: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.69G (2888603904 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.312686: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.42G (2599743488 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.313289: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.18G (2339769088 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.313322: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-07 06:20:44.313941: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.313965: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-07 06:20:44.321500: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.321538: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-07 06:20:44.322129: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.322146: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-07 06:20:44.329069: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.329116: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-07 06:20:44.329725: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.329746: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-07 06:20:44.365292: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.365389: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-07 06:20:44.366065: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.366090: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-07 06:20:44.372131: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.372163: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-07 06:20:44.372765: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.372786: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-07 06:20:44.408029: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.408658: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.410631: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.411274: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.458067: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.459011: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.461282: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.461930: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.491010: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.492202: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.494664: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.495881: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.502020: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.502681: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.504563: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.505240: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.511474: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.512175: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.513854: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.514520: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.544111: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.544855: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.545522: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.546207: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.550142: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.550756: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.568008: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.568751: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.569442: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.570120: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.583489: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.584232: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.584911: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.585600: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.590803: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.591928: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.598694: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.599775: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.613272: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.614361: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.619399: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.620484: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.621539: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.622654: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.624248: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.625289: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.636345: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.637106: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.637861: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.638532: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.639247: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.639908: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.640550: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.641202: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.658106: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.658863: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.727194: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.727294: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-02-07 06:20:44.728474: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.729604: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.737106: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.737825: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.738489: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.739163: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.747738: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.748434: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.765059: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.765824: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.766464: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.767117: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.771522: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.772248: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.772909: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.773528: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.774957: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.785186: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.785892: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.795682: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.796452: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.797196: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.797949: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.798653: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-07 06:20:44.799371: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.99G (3209560064 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 2 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.72344 max: 145.03750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00010824203491210938 nb_pixel_total : 257 time to create 1 rle with old method : 0.0006339550018310547 length of segment : 34 time for calcul the mask position with numpy : 9.441375732421875e-05 nb_pixel_total : 807 time to create 1 rle with old method : 0.0017561912536621094 length of segment : 39 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 945 time to create 1 rle with old method : 0.001983642578125 length of segment : 41 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.00034880638122558594 length of segment : 24 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 944 time to create 1 rle with old method : 0.002034425735473633 length of segment : 47 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.61406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 9.584426879882812e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.0005145072937011719 length of segment : 29 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 1033 time to create 1 rle with old method : 0.001975536346435547 length of segment : 41 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 921 time to create 1 rle with old method : 0.001631021499633789 length of segment : 46 time for calcul the mask position with numpy : 9.822845458984375e-05 nb_pixel_total : 1018 time to create 1 rle with old method : 0.002049684524536133 length of segment : 55 time for calcul the mask position with numpy : 9.775161743164062e-05 nb_pixel_total : 3389 time to create 1 rle with old method : 0.0053670406341552734 length of segment : 75 time for calcul the mask position with numpy : 0.0001366138458251953 nb_pixel_total : 339 time to create 1 rle with old method : 0.0007009506225585938 length of segment : 44 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 748 time to create 1 rle with old method : 0.0009951591491699219 length of segment : 56 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0008301734924316406 length of segment : 27 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.0005981922149658203 length of segment : 41 time for calcul the mask position with numpy : 0.0004899501800537109 nb_pixel_total : 485 time to create 1 rle with old method : 0.0008156299591064453 length of segment : 80 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 35 time to create 1 rle with old method : 9.274482727050781e-05 length of segment : 6 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.0003209114074707031 length of segment : 17 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.000213623046875 length of segment : 20 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 43 time to create 1 rle with old method : 0.0001201629638671875 length of segment : 7 time for calcul the mask position with numpy : 0.00012969970703125 nb_pixel_total : 1739 time to create 1 rle with old method : 0.002741575241088867 length of segment : 65 time for calcul the mask position with numpy : 0.00015997886657714844 nb_pixel_total : 1619 time to create 1 rle with old method : 0.0021512508392333984 length of segment : 63 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 1503 time to create 1 rle with old method : 0.002537965774536133 length of segment : 40 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.50469 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 0.00015592575073242188 nb_pixel_total : 1244 time to create 1 rle with old method : 0.003076791763305664 length of segment : 39 time for calcul the mask position with numpy : 0.00049591064453125 nb_pixel_total : 5591 time to create 1 rle with old method : 0.007955312728881836 length of segment : 119 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0006077289581298828 length of segment : 25 time for calcul the mask position with numpy : 0.00017189979553222656 nb_pixel_total : 1857 time to create 1 rle with old method : 0.0029489994049072266 length of segment : 75 time for calcul the mask position with numpy : 0.00012421607971191406 nb_pixel_total : 2379 time to create 1 rle with old method : 0.003765583038330078 length of segment : 47 time for calcul the mask position with numpy : 0.00011324882507324219 nb_pixel_total : 1916 time to create 1 rle with old method : 0.002948284149169922 length of segment : 73 time for calcul the mask position with numpy : 9.5367431640625e-05 nb_pixel_total : 1045 time to create 1 rle with old method : 0.0016961097717285156 length of segment : 43 time for calcul the mask position with numpy : 0.000152587890625 nb_pixel_total : 2708 time to create 1 rle with old method : 0.0037882328033447266 length of segment : 87 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.0004703998565673828 length of segment : 10 time for calcul the mask position with numpy : 0.00020313262939453125 nb_pixel_total : 6533 time to create 1 rle with old method : 0.009199142456054688 length of segment : 107 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 419 time to create 1 rle with old method : 0.0006153583526611328 length of segment : 26 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 721 time to create 1 rle with old method : 0.0012607574462890625 length of segment : 24 time for calcul the mask position with numpy : 0.00020241737365722656 nb_pixel_total : 1480 time to create 1 rle with old method : 0.0022978782653808594 length of segment : 92 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.33672 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 435 time to create 1 rle with old method : 0.0010178089141845703 length of segment : 23 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.0004048347473144531 length of segment : 24 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.0005645751953125 length of segment : 20 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 128.91641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 482 time to create 1 rle with old method : 0.0006821155548095703 length of segment : 18 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.00019168853759765625 length of segment : 11 time for calcul the mask position with numpy : 0.0006983280181884766 nb_pixel_total : 60380 time to create 1 rle with old method : 0.07950401306152344 length of segment : 273 time for calcul the mask position with numpy : 0.0006954669952392578 nb_pixel_total : 58051 time to create 1 rle with old method : 0.07247805595397949 length of segment : 283 Processing 1 images image shape: (400, 400, 3) min: 22.00000 max: 198.00000 molded_images shape: (1, 640, 640, 3) min: -85.91875 max: 71.06484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0013995170593261719 nb_pixel_total : 152330 time to create 1 rle with new method : 0.0020875930786132812 length of segment : 406 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.20391 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 0.00010085105895996094 nb_pixel_total : 337 time to create 1 rle with old method : 0.0008213520050048828 length of segment : 19 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 590 time to create 1 rle with old method : 0.001341104507446289 length of segment : 15 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.00038695335388183594 length of segment : 13 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 508 time to create 1 rle with old method : 0.001005411148071289 length of segment : 64 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 512 time to create 1 rle with old method : 0.0027904510498046875 length of segment : 38 time for calcul the mask position with numpy : 0.00019884109497070312 nb_pixel_total : 3303 time to create 1 rle with old method : 0.006619453430175781 length of segment : 55 time for calcul the mask position with numpy : 0.0002892017364501953 nb_pixel_total : 13168 time to create 1 rle with old method : 0.016992568969726562 length of segment : 110 time for calcul the mask position with numpy : 0.0001804828643798828 nb_pixel_total : 1929 time to create 1 rle with old method : 0.0026509761810302734 length of segment : 59 time for calcul the mask position with numpy : 9.799003601074219e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0006983280181884766 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.78203 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 876 time to create 1 rle with old method : 0.0012454986572265625 length of segment : 40 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.000507354736328125 length of segment : 36 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 406 time to create 1 rle with old method : 0.0006072521209716797 length of segment : 44 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.0002593994140625 length of segment : 14 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.0004355907440185547 length of segment : 17 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 863 time to create 1 rle with old method : 0.0010843276977539062 length of segment : 57 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 481 time to create 1 rle with old method : 0.0007467269897460938 length of segment : 16 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 176 time to create 1 rle with old method : 0.00033974647521972656 length of segment : 12 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 1129 time to create 1 rle with old method : 0.0022132396697998047 length of segment : 41 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 1110 time to create 1 rle with old method : 0.0015840530395507812 length of segment : 41 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.00044727325439453125 length of segment : 18 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0004944801330566406 length of segment : 31 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 567 time to create 1 rle with old method : 0.0007920265197753906 length of segment : 46 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.79766 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 323 time to create 1 rle with old method : 0.0004792213439941406 length of segment : 17 time for calcul the mask position with numpy : 0.0001609325408935547 nb_pixel_total : 3173 time to create 1 rle with old method : 0.0034379959106445312 length of segment : 150 time for calcul the mask position with numpy : 0.00024390220642089844 nb_pixel_total : 12640 time to create 1 rle with old method : 0.014995813369750977 length of segment : 243 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.0006284713745117188 length of segment : 22 time for calcul the mask position with numpy : 0.0001614093780517578 nb_pixel_total : 4621 time to create 1 rle with old method : 0.006760358810424805 length of segment : 118 time for calcul the mask position with numpy : 7.557868957519531e-05 nb_pixel_total : 830 time to create 1 rle with old method : 0.0011801719665527344 length of segment : 37 time for calcul the mask position with numpy : 0.00012230873107910156 nb_pixel_total : 4913 time to create 1 rle with old method : 0.0056040287017822266 length of segment : 110 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 1311 time to create 1 rle with old method : 0.0018084049224853516 length of segment : 42 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 501 time to create 1 rle with old method : 0.0007040500640869141 length of segment : 27 time for calcul the mask position with numpy : 0.00017118453979492188 nb_pixel_total : 6373 time to create 1 rle with old method : 0.007264375686645508 length of segment : 206 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 368 time to create 1 rle with old method : 0.0006482601165771484 length of segment : 28 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 134.99062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 515 time to create 1 rle with old method : 0.0007371902465820312 length of segment : 35 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.00040459632873535156 length of segment : 40 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 1608 time to create 1 rle with old method : 0.0020897388458251953 length of segment : 77 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 320 time to create 1 rle with old method : 0.00040268898010253906 length of segment : 33 time for calcul the mask position with numpy : 0.0001251697540283203 nb_pixel_total : 736 time to create 1 rle with old method : 0.0011334419250488281 length of segment : 116 time for calcul the mask position with numpy : 0.00019621849060058594 nb_pixel_total : 3039 time to create 1 rle with old method : 0.0036687850952148438 length of segment : 209 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 290 time to create 1 rle with old method : 0.0003800392150878906 length of segment : 31 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 645 time to create 1 rle with old method : 0.0008256435394287109 length of segment : 42 time for calcul the mask position with numpy : 9.059906005859375e-05 nb_pixel_total : 382 time to create 1 rle with old method : 0.0006449222564697266 length of segment : 67 time for calcul the mask position with numpy : 7.724761962890625e-05 nb_pixel_total : 1616 time to create 1 rle with old method : 0.001992940902709961 length of segment : 86 Processing 1 images image shape: (280, 400, 3) min: 17.00000 max: 197.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 70.95156 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.001108407974243164 nb_pixel_total : 106694 time to create 1 rle with old method : 0.13695955276489258 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.04141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 295 time to create 1 rle with old method : 0.00046563148498535156 length of segment : 28 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0004267692565917969 length of segment : 18 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.00027370452880859375 length of segment : 18 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 1278 time to create 1 rle with old method : 0.0015904903411865234 length of segment : 34 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003590583801269531 length of segment : 24 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 589 time to create 1 rle with old method : 0.0007865428924560547 length of segment : 25 time for calcul the mask position with numpy : 0.00011706352233886719 nb_pixel_total : 5008 time to create 1 rle with old method : 0.006033658981323242 length of segment : 81 time for calcul the mask position with numpy : 0.00011491775512695312 nb_pixel_total : 2516 time to create 1 rle with old method : 0.0035009384155273438 length of segment : 121 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 425 time to create 1 rle with old method : 0.0006701946258544922 length of segment : 30 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 355 time to create 1 rle with old method : 0.0005381107330322266 length of segment : 31 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 984 time to create 1 rle with old method : 0.001272439956665039 length of segment : 50 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.00038361549377441406 length of segment : 27 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.0003380775451660156 length of segment : 16 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 127 time to create 1 rle with old method : 0.0002894401550292969 length of segment : 11 time for calcul the mask position with numpy : 0.00017261505126953125 nb_pixel_total : 5343 time to create 1 rle with old method : 0.007500171661376953 length of segment : 82 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.00035953521728515625 length of segment : 15 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 602 time to create 1 rle with old method : 0.0010113716125488281 length of segment : 27 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.45547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 108 time to create 1 rle with old method : 0.0001819133758544922 length of segment : 13 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 440 time to create 1 rle with old method : 0.0006594657897949219 length of segment : 28 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0005393028259277344 length of segment : 25 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.00019812583923339844 length of segment : 10 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 86 time to create 1 rle with old method : 0.0001575946807861328 length of segment : 8 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.00029659271240234375 length of segment : 16 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.0003063678741455078 length of segment : 16 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.00033974647521972656 length of segment : 16 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 852 time to create 1 rle with old method : 0.00113677978515625 length of segment : 38 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.00015115737915039062 length of segment : 11 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.00038313865661621094 length of segment : 20 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.0002512931823730469 length of segment : 10 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.00024127960205078125 length of segment : 24 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 1191 time to create 1 rle with old method : 0.0014424324035644531 length of segment : 57 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 543 time to create 1 rle with old method : 0.0007543563842773438 length of segment : 30 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.20547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 21 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.0003616809844970703 length of segment : 20 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.0004343986511230469 length of segment : 21 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 1472 time to create 1 rle with old method : 0.001967191696166992 length of segment : 34 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 166 time to create 1 rle with old method : 0.0002720355987548828 length of segment : 33 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.0002853870391845703 length of segment : 14 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 439 time to create 1 rle with old method : 0.0005931854248046875 length of segment : 22 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 326 time to create 1 rle with old method : 0.00048160552978515625 length of segment : 19 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 55 time to create 1 rle with old method : 0.00012803077697753906 length of segment : 7 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.0002970695495605469 length of segment : 19 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1375 time to create 1 rle with old method : 0.0017342567443847656 length of segment : 67 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1018 time to create 1 rle with old method : 0.0013096332550048828 length of segment : 47 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 47 time to create 1 rle with old method : 0.0001087188720703125 length of segment : 16 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 152 time to create 1 rle with old method : 0.00035643577575683594 length of segment : 22 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 215 time to create 1 rle with old method : 0.0004658699035644531 length of segment : 20 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 1281 time to create 1 rle with old method : 0.0026092529296875 length of segment : 34 time for calcul the mask position with numpy : 0.0001277923583984375 nb_pixel_total : 1050 time to create 1 rle with old method : 0.002087116241455078 length of segment : 26 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0005679130554199219 length of segment : 39 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.0003190040588378906 length of segment : 8 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 38 time to create 1 rle with old method : 0.00010156631469726562 length of segment : 21 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0003714561462402344 length of segment : 16 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.00030684471130371094 length of segment : 16 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 135.35000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 9.417533874511719e-05 nb_pixel_total : 475 time to create 1 rle with old method : 0.0011904239654541016 length of segment : 25 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 42 time to create 1 rle with old method : 0.0001544952392578125 length of segment : 9 time for calcul the mask position with numpy : 0.00011610984802246094 nb_pixel_total : 543 time to create 1 rle with old method : 0.0012927055358886719 length of segment : 62 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.05156 max: 145.54141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.0004203319549560547 length of segment : 32 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 888 time to create 1 rle with old method : 0.0013833045959472656 length of segment : 29 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.00017762184143066406 length of segment : 16 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 839 time to create 1 rle with old method : 0.0011513233184814453 length of segment : 31 time for calcul the mask position with numpy : 0.00039076805114746094 nb_pixel_total : 18348 time to create 1 rle with old method : 0.02475881576538086 length of segment : 162 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.66875 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.00028824806213378906 length of segment : 29 time for calcul the mask position with numpy : 9.703636169433594e-05 nb_pixel_total : 2014 time to create 1 rle with old method : 0.0027418136596679688 length of segment : 66 time for calcul the mask position with numpy : 8.96453857421875e-05 nb_pixel_total : 1813 time to create 1 rle with old method : 0.0025844573974609375 length of segment : 58 time for calcul the mask position with numpy : 0.00039124488830566406 nb_pixel_total : 1639 time to create 1 rle with old method : 0.002254009246826172 length of segment : 118 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 717 time to create 1 rle with old method : 0.0010497570037841797 length of segment : 29 time for calcul the mask position with numpy : 0.00010728836059570312 nb_pixel_total : 3794 time to create 1 rle with old method : 0.004991054534912109 length of segment : 74 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 166 time to create 1 rle with old method : 0.00042700767517089844 length of segment : 16 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 561 time to create 1 rle with old method : 0.0007503032684326172 length of segment : 27 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 215 time to create 1 rle with old method : 0.0003254413604736328 length of segment : 18 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1122 time to create 1 rle with old method : 0.0015273094177246094 length of segment : 40 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 616 time to create 1 rle with old method : 0.0009486675262451172 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.50469 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 0.00010180473327636719 nb_pixel_total : 1407 time to create 1 rle with old method : 0.0018558502197265625 length of segment : 51 time for calcul the mask position with numpy : 0.0001475811004638672 nb_pixel_total : 6644 time to create 1 rle with old method : 0.008406400680541992 length of segment : 105 time for calcul the mask position with numpy : 0.00011968612670898438 nb_pixel_total : 3554 time to create 1 rle with old method : 0.0046732425689697266 length of segment : 38 time for calcul the mask position with numpy : 0.00021839141845703125 nb_pixel_total : 2809 time to create 1 rle with old method : 0.0035829544067382812 length of segment : 102 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.0005142688751220703 length of segment : 34 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 1205 time to create 1 rle with old method : 0.0016820430755615234 length of segment : 100 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 111 time to create 1 rle with old method : 0.0002548694610595703 length of segment : 4 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 2219 time to create 1 rle with old method : 0.0030851364135742188 length of segment : 37 time for calcul the mask position with numpy : 0.000125885009765625 nb_pixel_total : 1601 time to create 1 rle with old method : 0.002139568328857422 length of segment : 91 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 613 time to create 1 rle with old method : 0.0010724067687988281 length of segment : 22 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.00041866302490234375 length of segment : 11 time for calcul the mask position with numpy : 0.00035190582275390625 nb_pixel_total : 12194 time to create 1 rle with old method : 0.014493703842163086 length of segment : 167 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 1048 time to create 1 rle with old method : 0.0015888214111328125 length of segment : 25 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.82500 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 250.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 122.20156 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 1557 time to create 1 rle with old method : 0.0019838809967041016 length of segment : 98 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 492 time to create 1 rle with old method : 0.0007197856903076172 length of segment : 19 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 91 time to create 1 rle with old method : 0.0001685619354248047 length of segment : 10 Processing 1 images image shape: (400, 400, 3) min: 18.00000 max: 198.00000 molded_images shape: (1, 640, 640, 3) min: -85.36016 max: 71.06484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0016007423400878906 nb_pixel_total : 151128 time to create 1 rle with new method : 0.0022542476654052734 length of segment : 395 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.13750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 331 time to create 1 rle with old method : 0.0006310939788818359 length of segment : 19 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 1741 time to create 1 rle with old method : 0.002696990966796875 length of segment : 53 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 591 time to create 1 rle with old method : 0.0009157657623291016 length of segment : 14 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.00028324127197265625 length of segment : 13 time for calcul the mask position with numpy : 0.0002090930938720703 nb_pixel_total : 9113 time to create 1 rle with old method : 0.011192798614501953 length of segment : 112 time for calcul the mask position with numpy : 0.00040221214294433594 nb_pixel_total : 13185 time to create 1 rle with old method : 0.018187761306762695 length of segment : 111 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 734 time to create 1 rle with old method : 0.0010268688201904297 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.66875 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 0.00011682510375976562 nb_pixel_total : 797 time to create 1 rle with old method : 0.0016744136810302734 length of segment : 35 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 450 time to create 1 rle with old method : 0.0006961822509765625 length of segment : 16 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 654 time to create 1 rle with old method : 0.0009179115295410156 length of segment : 40 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 817 time to create 1 rle with old method : 0.0010662078857421875 length of segment : 31 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.0002491474151611328 length of segment : 11 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 518 time to create 1 rle with old method : 0.0006957054138183594 length of segment : 43 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.00023603439331054688 length of segment : 15 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0004851818084716797 length of segment : 15 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 664 time to create 1 rle with old method : 0.0009062290191650391 length of segment : 57 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 281 time to create 1 rle with old method : 0.0005769729614257812 length of segment : 20 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 481 time to create 1 rle with old method : 0.0008676052093505859 length of segment : 34 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 1100 time to create 1 rle with old method : 0.0014858245849609375 length of segment : 42 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 762 time to create 1 rle with old method : 0.0010232925415039062 length of segment : 28 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 1146 time to create 1 rle with old method : 0.001489877700805664 length of segment : 44 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 1178 time to create 1 rle with old method : 0.0015926361083984375 length of segment : 42 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.09063 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 327 time to create 1 rle with old method : 0.0005209445953369141 length of segment : 15 time for calcul the mask position with numpy : 0.000217437744140625 nb_pixel_total : 2313 time to create 1 rle with old method : 0.0028781890869140625 length of segment : 145 time for calcul the mask position with numpy : 9.489059448242188e-05 nb_pixel_total : 1437 time to create 1 rle with old method : 0.001998424530029297 length of segment : 41 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1188 time to create 1 rle with old method : 0.001476287841796875 length of segment : 38 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.0008242130279541016 length of segment : 22 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 596 time to create 1 rle with old method : 0.0008366107940673828 length of segment : 29 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 492 time to create 1 rle with old method : 0.0006544589996337891 length of segment : 24 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0004947185516357422 length of segment : 16 time for calcul the mask position with numpy : 0.00016951560974121094 nb_pixel_total : 6306 time to create 1 rle with old method : 0.007609367370605469 length of segment : 134 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 623 time to create 1 rle with old method : 0.0009706020355224609 length of segment : 33 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 133.76016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0005209445953369141 length of segment : 27 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 524 time to create 1 rle with old method : 0.0007202625274658203 length of segment : 35 time for calcul the mask position with numpy : 0.0002086162567138672 nb_pixel_total : 3805 time to create 1 rle with old method : 0.004555702209472656 length of segment : 223 time for calcul the mask position with numpy : 9.703636169433594e-05 nb_pixel_total : 1730 time to create 1 rle with old method : 0.0022382736206054688 length of segment : 85 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.0003657341003417969 length of segment : 33 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 530 time to create 1 rle with old method : 0.0007383823394775391 length of segment : 37 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 404 time to create 1 rle with old method : 0.0006313323974609375 length of segment : 31 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 1754 time to create 1 rle with old method : 0.0025115013122558594 length of segment : 86 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 386 time to create 1 rle with old method : 0.0005590915679931641 length of segment : 31 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.0005962848663330078 length of segment : 32 Processing 1 images image shape: (280, 400, 3) min: 11.00000 max: 193.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 68.38125 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.005049467086791992 nb_pixel_total : 106754 time to create 1 rle with old method : 0.1314866542816162 length of segment : 281 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.17812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 21 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.0002493858337402344 length of segment : 16 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.0004050731658935547 length of segment : 19 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.00041747093200683594 length of segment : 16 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.0002493858337402344 length of segment : 15 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 448 time to create 1 rle with old method : 0.0006020069122314453 length of segment : 31 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 139 time to create 1 rle with old method : 0.00023031234741210938 length of segment : 11 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003883838653564453 length of segment : 31 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0003647804260253906 length of segment : 32 time for calcul the mask position with numpy : 9.202957153320312e-05 nb_pixel_total : 2023 time to create 1 rle with old method : 0.0026006698608398438 length of segment : 62 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.0004038810729980469 length of segment : 22 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 1656 time to create 1 rle with old method : 0.0021440982818603516 length of segment : 41 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 1489 time to create 1 rle with old method : 0.0020322799682617188 length of segment : 67 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 518 time to create 1 rle with old method : 0.0007381439208984375 length of segment : 42 time for calcul the mask position with numpy : 0.00012922286987304688 nb_pixel_total : 4927 time to create 1 rle with old method : 0.006287097930908203 length of segment : 83 time for calcul the mask position with numpy : 8.20159912109375e-05 nb_pixel_total : 2055 time to create 1 rle with old method : 0.002532958984375 length of segment : 58 time for calcul the mask position with numpy : 8.988380432128906e-05 nb_pixel_total : 3040 time to create 1 rle with old method : 0.0037450790405273438 length of segment : 63 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 687 time to create 1 rle with old method : 0.0010218620300292969 length of segment : 33 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 786 time to create 1 rle with old method : 0.0010249614715576172 length of segment : 34 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 703 time to create 1 rle with old method : 0.0010013580322265625 length of segment : 29 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 1054 time to create 1 rle with old method : 0.0013086795806884766 length of segment : 51 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 560 time to create 1 rle with old method : 0.0007944107055664062 length of segment : 23 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.02578 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.00021505355834960938 length of segment : 13 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 74 time to create 1 rle with old method : 0.00014925003051757812 length of segment : 8 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 115 time to create 1 rle with old method : 0.0002562999725341797 length of segment : 11 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 467 time to create 1 rle with old method : 0.0007715225219726562 length of segment : 27 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.0004017353057861328 length of segment : 15 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 1317 time to create 1 rle with old method : 0.0016672611236572266 length of segment : 58 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 507 time to create 1 rle with old method : 0.0006821155548095703 length of segment : 29 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003464221954345703 length of segment : 17 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002465248107910156 length of segment : 22 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 279 time to create 1 rle with old method : 0.00040650367736816406 length of segment : 16 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1372 time to create 1 rle with old method : 0.001657724380493164 length of segment : 59 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 881 time to create 1 rle with old method : 0.0010535717010498047 length of segment : 40 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 742 time to create 1 rle with old method : 0.0009438991546630859 length of segment : 40 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.85000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 1550 time to create 1 rle with old method : 0.0019526481628417969 length of segment : 37 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.0003235340118408203 length of segment : 21 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 393 time to create 1 rle with old method : 0.0005102157592773438 length of segment : 59 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.00037598609924316406 length of segment : 20 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 455 time to create 1 rle with old method : 0.0006763935089111328 length of segment : 21 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.00024437904357910156 length of segment : 13 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.0002970695495605469 length of segment : 21 time for calcul the mask position with numpy : 0.00017142295837402344 nb_pixel_total : 9751 time to create 1 rle with old method : 0.011467218399047852 length of segment : 180 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.0003726482391357422 length of segment : 31 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 522 time to create 1 rle with old method : 0.0008196830749511719 length of segment : 33 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 11 time to create 1 rle with old method : 4.482269287109375e-05 length of segment : 7 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 1417 time to create 1 rle with old method : 0.0017578601837158203 length of segment : 72 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 1009 time to create 1 rle with old method : 0.0012660026550292969 length of segment : 44 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 691 time to create 1 rle with old method : 0.0009410381317138672 length of segment : 49 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 135.97500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.000997304916381836 length of segment : 27 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 48 time to create 1 rle with old method : 0.00013327598571777344 length of segment : 8 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 442 time to create 1 rle with old method : 0.0008432865142822266 length of segment : 25 Detection mask done ! Trying to reset tf kernel 2061156 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1749 tf kernel not reseted sub process len(results) : 270 len(list_Values) 270 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 270 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3051 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 270 chid ids of type : 4228 Number RLEs to save : 13232 save missing photos in datou_result : time spend for datou_step_exec : 26.73687171936035 time spend to save output : 1.683135986328125 total time spend for step 1 : 28.420007705688477 step2:brightness Fri Feb 7 06:20:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1738905628_2060708_1335300557_637cab4a60e6630b7c5d0df49d521cc2.jpg treat image : temp/1738905628_2060708_1335300528_e4ca6a8d4f3470a325f058cc23bd1abf.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.13985204696655273 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.017709016799926758 save missing photos in datou_result : time spend for datou_step_exec : 0.5559017658233643 time spend to save output : 0.16200661659240723 total time spend for step 2 : 0.7179083824157715 step3:blur_detection Fri Feb 7 06:20:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1738905628_2060708_1335300557_637cab4a60e6630b7c5d0df49d521cc2.jpg resize: (1080, 1920) 1335300557 -7.713341034734607 treat image : temp/1738905628_2060708_1335300528_e4ca6a8d4f3470a325f058cc23bd1abf.jpg resize: (1080, 1920) 1335300528 -7.706642203290832 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.05143260955810547 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.01509404182434082 save missing photos in datou_result : time spend for datou_step_exec : 2.245684862136841 time spend to save output : 0.07101273536682129 total time spend for step 3 : 2.316697597503662 step4:rle_unique_nms_with_priority Fri Feb 7 06:21:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 270 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 143 nb_hashtags : 7 time to prepare the origin masks : 1.231492280960083 time for calcul the mask position with numpy : 0.06899189949035645 nb_pixel_total : 1616576 time to create 1 rle with new method : 0.5195105075836182 time for calcul the mask position with numpy : 0.008896589279174805 nb_pixel_total : 2708 time to create 1 rle with old method : 0.003286600112915039 time for calcul the mask position with numpy : 0.008634805679321289 nb_pixel_total : 1327 time to create 1 rle with old method : 0.0016825199127197266 time for calcul the mask position with numpy : 0.008717536926269531 nb_pixel_total : 5591 time to create 1 rle with old method : 0.006836652755737305 time for calcul the mask position with numpy : 0.008738279342651367 nb_pixel_total : 3389 time to create 1 rle with old method : 0.004038333892822266 time for calcul the mask position with numpy : 0.008469581604003906 nb_pixel_total : 301 time to create 1 rle with old method : 0.0004024505615234375 time for calcul the mask position with numpy : 0.008486509323120117 nb_pixel_total : 37 time to create 1 rle with old method : 8.58306884765625e-05 time for calcul the mask position with numpy : 0.008585453033447266 nb_pixel_total : 168 time to create 1 rle with old method : 0.00023412704467773438 time for calcul the mask position with numpy : 0.01113128662109375 nb_pixel_total : 257 time to create 1 rle with old method : 0.0005261898040771484 time for calcul the mask position with numpy : 0.009321212768554688 nb_pixel_total : 921 time to create 1 rle with old method : 0.0010619163513183594 time for calcul the mask position with numpy : 0.00838017463684082 nb_pixel_total : 55 time to create 1 rle with old method : 8.58306884765625e-05 time for calcul the mask position with numpy : 0.0084686279296875 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006072521209716797 time for calcul the mask position with numpy : 0.00839853286743164 nb_pixel_total : 807 time to create 1 rle with old method : 0.0009996891021728516 time for calcul the mask position with numpy : 0.008401155471801758 nb_pixel_total : 35 time to create 1 rle with old method : 5.125999450683594e-05 time for calcul the mask position with numpy : 0.008762836456298828 nb_pixel_total : 60267 time to create 1 rle with old method : 0.06720447540283203 time for calcul the mask position with numpy : 0.008531570434570312 nb_pixel_total : 136 time to create 1 rle with old method : 0.0001819133758544922 time for calcul the mask position with numpy : 0.00847315788269043 nb_pixel_total : 43 time to create 1 rle with old method : 5.888938903808594e-05 time for calcul the mask position with numpy : 0.008392095565795898 nb_pixel_total : 5477 time to create 1 rle with old method : 0.00670933723449707 time for calcul the mask position with numpy : 0.008722543716430664 nb_pixel_total : 1033 time to create 1 rle with old method : 0.001255035400390625 time for calcul the mask position with numpy : 0.008659124374389648 nb_pixel_total : 74 time to create 1 rle with old method : 0.00011205673217773438 time for calcul the mask position with numpy : 0.008557558059692383 nb_pixel_total : 1045 time to create 1 rle with old method : 0.0012683868408203125 time for calcul the mask position with numpy : 0.008641719818115234 nb_pixel_total : 485 time to create 1 rle with old method : 0.0006029605865478516 time for calcul the mask position with numpy : 0.008785486221313477 nb_pixel_total : 1739 time to create 1 rle with old method : 0.002152681350708008 time for calcul the mask position with numpy : 0.009004592895507812 nb_pixel_total : 27 time to create 1 rle with old method : 7.05718994140625e-05 time for calcul the mask position with numpy : 0.008871078491210938 nb_pixel_total : 218 time to create 1 rle with old method : 0.0002899169921875 time for calcul the mask position with numpy : 0.008527994155883789 nb_pixel_total : 748 time to create 1 rle with old method : 0.0009455680847167969 time for calcul the mask position with numpy : 0.008629560470581055 nb_pixel_total : 1018 time to create 1 rle with old method : 0.0012581348419189453 time for calcul the mask position with numpy : 0.008618831634521484 nb_pixel_total : 1503 time to create 1 rle with old method : 0.0017955303192138672 time for calcul the mask position with numpy : 0.008771419525146484 nb_pixel_total : 207 time to create 1 rle with old method : 0.00027060508728027344 time for calcul the mask position with numpy : 0.008661985397338867 nb_pixel_total : 102 time to create 1 rle with old method : 0.0001461505889892578 time for calcul the mask position with numpy : 0.008680105209350586 nb_pixel_total : 361 time to create 1 rle with old method : 0.00045013427734375 time for calcul the mask position with numpy : 0.00863957405090332 nb_pixel_total : 420 time to create 1 rle with old method : 0.0005328655242919922 time for calcul the mask position with numpy : 0.008711099624633789 nb_pixel_total : 236 time to create 1 rle with old method : 0.0003178119659423828 time for calcul the mask position with numpy : 0.009151935577392578 nb_pixel_total : 435 time to create 1 rle with old method : 0.0006029605865478516 time for calcul the mask position with numpy : 0.008915424346923828 nb_pixel_total : 721 time to create 1 rle with old method : 0.0009186267852783203 time for calcul the mask position with numpy : 0.00877690315246582 nb_pixel_total : 2379 time to create 1 rle with old method : 0.002880096435546875 time for calcul the mask position with numpy : 0.00865483283996582 nb_pixel_total : 6533 time to create 1 rle with old method : 0.007630348205566406 time for calcul the mask position with numpy : 0.008750677108764648 nb_pixel_total : 435 time to create 1 rle with old method : 0.0006003379821777344 time for calcul the mask position with numpy : 0.008843660354614258 nb_pixel_total : 1857 time to create 1 rle with old method : 0.0024356842041015625 time for calcul the mask position with numpy : 0.008823633193969727 nb_pixel_total : 113 time to create 1 rle with old method : 0.0001697540283203125 time for calcul the mask position with numpy : 0.008807182312011719 nb_pixel_total : 17 time to create 1 rle with old method : 7.963180541992188e-05 time for calcul the mask position with numpy : 0.008774518966674805 nb_pixel_total : 1244 time to create 1 rle with old method : 0.001519918441772461 time for calcul the mask position with numpy : 0.008666515350341797 nb_pixel_total : 482 time to create 1 rle with old method : 0.0006062984466552734 time for calcul the mask position with numpy : 0.010019063949584961 nb_pixel_total : 152330 time to create 1 rle with new method : 0.2158339023590088 time for calcul the mask position with numpy : 0.008777856826782227 nb_pixel_total : 12640 time to create 1 rle with old method : 0.014874458312988281 time for calcul the mask position with numpy : 0.008593082427978516 nb_pixel_total : 736 time to create 1 rle with old method : 0.0009355545043945312 time for calcul the mask position with numpy : 0.008565902709960938 nb_pixel_total : 481 time to create 1 rle with old method : 0.0005819797515869141 time for calcul the mask position with numpy : 0.008397817611694336 nb_pixel_total : 567 time to create 1 rle with old method : 0.0006816387176513672 time for calcul the mask position with numpy : 0.008413553237915039 nb_pixel_total : 830 time to create 1 rle with old method : 0.0009660720825195312 time for calcul the mask position with numpy : 0.008430719375610352 nb_pixel_total : 876 time to create 1 rle with old method : 0.001058816909790039 time for calcul the mask position with numpy : 0.008440732955932617 nb_pixel_total : 76 time to create 1 rle with old method : 0.00011181831359863281 time for calcul the mask position with numpy : 0.008431196212768555 nb_pixel_total : 405 time to create 1 rle with old method : 0.0004830360412597656 time for calcul the mask position with numpy : 0.008493661880493164 nb_pixel_total : 69 time to create 1 rle with old method : 0.00012373924255371094 time for calcul the mask position with numpy : 0.008895635604858398 nb_pixel_total : 1737 time to create 1 rle with old method : 0.0023593902587890625 time for calcul the mask position with numpy : 0.008403778076171875 nb_pixel_total : 3173 time to create 1 rle with old method : 0.0037331581115722656 time for calcul the mask position with numpy : 0.008693218231201172 nb_pixel_total : 1311 time to create 1 rle with old method : 0.0015556812286376953 time for calcul the mask position with numpy : 0.00860738754272461 nb_pixel_total : 645 time to create 1 rle with old method : 0.0007588863372802734 time for calcul the mask position with numpy : 0.008534908294677734 nb_pixel_total : 237 time to create 1 rle with old method : 0.0003197193145751953 time for calcul the mask position with numpy : 0.008789777755737305 nb_pixel_total : 142 time to create 1 rle with old method : 0.0001995563507080078 time for calcul the mask position with numpy : 0.008453369140625 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003151893615722656 time for calcul the mask position with numpy : 0.00842905044555664 nb_pixel_total : 3039 time to create 1 rle with old method : 0.003804445266723633 time for calcul the mask position with numpy : 0.008486032485961914 nb_pixel_total : 21 time to create 1 rle with old method : 8.440017700195312e-05 time for calcul the mask position with numpy : 0.00857400894165039 nb_pixel_total : 1129 time to create 1 rle with old method : 0.0013327598571777344 time for calcul the mask position with numpy : 0.008561134338378906 nb_pixel_total : 6373 time to create 1 rle with old method : 0.008095502853393555 time for calcul the mask position with numpy : 0.011729240417480469 nb_pixel_total : 3303 time to create 1 rle with old method : 0.004634380340576172 time for calcul the mask position with numpy : 0.008460044860839844 nb_pixel_total : 403 time to create 1 rle with old method : 0.0005106925964355469 time for calcul the mask position with numpy : 0.008527755737304688 nb_pixel_total : 373 time to create 1 rle with old method : 0.0005185604095458984 time for calcul the mask position with numpy : 0.009200096130371094 nb_pixel_total : 1510 time to create 1 rle with old method : 0.001996278762817383 time for calcul the mask position with numpy : 0.008585691452026367 nb_pixel_total : 241 time to create 1 rle with old method : 0.00031495094299316406 time for calcul the mask position with numpy : 0.008635997772216797 nb_pixel_total : 863 time to create 1 rle with old method : 0.0016660690307617188 time for calcul the mask position with numpy : 0.009917020797729492 nb_pixel_total : 501 time to create 1 rle with old method : 0.0006103515625 time for calcul the mask position with numpy : 0.008602380752563477 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005393028259277344 time for calcul the mask position with numpy : 0.008710622787475586 nb_pixel_total : 15 time to create 1 rle with old method : 7.796287536621094e-05 time for calcul the mask position with numpy : 0.008698463439941406 nb_pixel_total : 515 time to create 1 rle with old method : 0.0006594657897949219 time for calcul the mask position with numpy : 0.008799552917480469 nb_pixel_total : 12892 time to create 1 rle with old method : 0.017231225967407227 time for calcul the mask position with numpy : 0.008765459060668945 nb_pixel_total : 320 time to create 1 rle with old method : 0.00041365623474121094 time for calcul the mask position with numpy : 0.008685111999511719 nb_pixel_total : 5 time to create 1 rle with old method : 7.915496826171875e-05 time for calcul the mask position with numpy : 0.008759021759033203 nb_pixel_total : 508 time to create 1 rle with old method : 0.0006678104400634766 time for calcul the mask position with numpy : 0.00858616828918457 nb_pixel_total : 323 time to create 1 rle with old method : 0.0004177093505859375 time for calcul the mask position with numpy : 0.00864267349243164 nb_pixel_total : 4621 time to create 1 rle with old method : 0.005324840545654297 time for calcul the mask position with numpy : 0.008582830429077148 nb_pixel_total : 88 time to create 1 rle with old method : 0.00017213821411132812 time for calcul the mask position with numpy : 0.008634328842163086 nb_pixel_total : 1608 time to create 1 rle with old method : 0.001972198486328125 time for calcul the mask position with numpy : 0.008573293685913086 nb_pixel_total : 337 time to create 1 rle with old method : 0.0004322528839111328 time for calcul the mask position with numpy : 0.008499860763549805 nb_pixel_total : 484 time to create 1 rle with old method : 0.000606536865234375 time for calcul the mask position with numpy : 0.008685588836669922 nb_pixel_total : 512 time to create 1 rle with old method : 0.0007007122039794922 time for calcul the mask position with numpy : 0.00872182846069336 nb_pixel_total : 173 time to create 1 rle with old method : 0.00025725364685058594 time for calcul the mask position with numpy : 0.008691787719726562 nb_pixel_total : 590 time to create 1 rle with old method : 0.0007557868957519531 time for calcul the mask position with numpy : 0.009273767471313477 nb_pixel_total : 106694 time to create 1 rle with old method : 0.12748980522155762 time for calcul the mask position with numpy : 0.008475542068481445 nb_pixel_total : 283 time to create 1 rle with old method : 0.0003628730773925781 time for calcul the mask position with numpy : 0.008426189422607422 nb_pixel_total : 543 time to create 1 rle with old method : 0.0006880760192871094 time for calcul the mask position with numpy : 0.008521795272827148 nb_pixel_total : 1278 time to create 1 rle with old method : 0.0015649795532226562 time for calcul the mask position with numpy : 0.00855398178100586 nb_pixel_total : 295 time to create 1 rle with old method : 0.00041294097900390625 time for calcul the mask position with numpy : 0.008486509323120117 nb_pixel_total : 1375 time to create 1 rle with old method : 0.001623392105102539 time for calcul the mask position with numpy : 0.008469820022583008 nb_pixel_total : 355 time to create 1 rle with old method : 0.0004298686981201172 time for calcul the mask position with numpy : 0.008434534072875977 nb_pixel_total : 127 time to create 1 rle with old method : 0.0001747608184814453 time for calcul the mask position with numpy : 0.008675098419189453 nb_pixel_total : 97 time to create 1 rle with old method : 0.00015211105346679688 time for calcul the mask position with numpy : 0.008422613143920898 nb_pixel_total : 26 time to create 1 rle with old method : 4.8160552978515625e-05 time for calcul the mask position with numpy : 0.008397340774536133 nb_pixel_total : 589 time to create 1 rle with old method : 0.0007255077362060547 time for calcul the mask position with numpy : 0.008774518966674805 nb_pixel_total : 2516 time to create 1 rle with old method : 0.0030395984649658203 time for calcul the mask position with numpy : 0.008547306060791016 nb_pixel_total : 8 time to create 1 rle with old method : 4.3392181396484375e-05 time for calcul the mask position with numpy : 0.008591651916503906 nb_pixel_total : 210 time to create 1 rle with old method : 0.0002799034118652344 time for calcul the mask position with numpy : 0.008561372756958008 nb_pixel_total : 108 time to create 1 rle with old method : 0.0001571178436279297 time for calcul the mask position with numpy : 0.008553743362426758 nb_pixel_total : 440 time to create 1 rle with old method : 0.0005447864532470703 time for calcul the mask position with numpy : 0.008565902709960938 nb_pixel_total : 425 time to create 1 rle with old method : 0.0005915164947509766 time for calcul the mask position with numpy : 0.008608102798461914 nb_pixel_total : 212 time to create 1 rle with old method : 0.00028586387634277344 time for calcul the mask position with numpy : 0.008589982986450195 nb_pixel_total : 205 time to create 1 rle with old method : 0.00027441978454589844 time for calcul the mask position with numpy : 0.008559942245483398 nb_pixel_total : 13 time to create 1 rle with old method : 3.933906555175781e-05 time for calcul the mask position with numpy : 0.0085601806640625 nb_pixel_total : 166 time to create 1 rle with old method : 0.00024008750915527344 time for calcul the mask position with numpy : 0.01058197021484375 nb_pixel_total : 439 time to create 1 rle with old method : 0.0009541511535644531 time for calcul the mask position with numpy : 0.012104272842407227 nb_pixel_total : 543 time to create 1 rle with old method : 0.0006983280181884766 time for calcul the mask position with numpy : 0.008746147155761719 nb_pixel_total : 255 time to create 1 rle with old method : 0.00034499168395996094 time for calcul the mask position with numpy : 0.008645057678222656 nb_pixel_total : 177 time to create 1 rle with old method : 0.00023674964904785156 time for calcul the mask position with numpy : 0.008679866790771484 nb_pixel_total : 287 time to create 1 rle with old method : 0.0003712177276611328 time for calcul the mask position with numpy : 0.008431673049926758 nb_pixel_total : 475 time to create 1 rle with old method : 0.0005753040313720703 time for calcul the mask position with numpy : 0.008502721786499023 nb_pixel_total : 169 time to create 1 rle with old method : 0.00022411346435546875 time for calcul the mask position with numpy : 0.008410215377807617 nb_pixel_total : 326 time to create 1 rle with old method : 0.0004029273986816406 time for calcul the mask position with numpy : 0.008402824401855469 nb_pixel_total : 80 time to create 1 rle with old method : 0.00011038780212402344 time for calcul the mask position with numpy : 0.008424997329711914 nb_pixel_total : 55 time to create 1 rle with old method : 9.012222290039062e-05 time for calcul the mask position with numpy : 0.008554697036743164 nb_pixel_total : 3 time to create 1 rle with old method : 3.266334533691406e-05 time for calcul the mask position with numpy : 0.008645772933959961 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002677440643310547 time for calcul the mask position with numpy : 0.008619546890258789 nb_pixel_total : 30 time to create 1 rle with old method : 7.224082946777344e-05 time for calcul the mask position with numpy : 0.00866556167602539 nb_pixel_total : 152 time to create 1 rle with old method : 0.00022220611572265625 time for calcul the mask position with numpy : 0.008562326431274414 nb_pixel_total : 255 time to create 1 rle with old method : 0.00035762786865234375 time for calcul the mask position with numpy : 0.00873112678527832 nb_pixel_total : 38 time to create 1 rle with old method : 0.0001220703125 time for calcul the mask position with numpy : 0.00883936882019043 nb_pixel_total : 1281 time to create 1 rle with old method : 0.0017619132995605469 time for calcul the mask position with numpy : 0.01100015640258789 nb_pixel_total : 197 time to create 1 rle with old method : 0.00046753883361816406 time for calcul the mask position with numpy : 0.009078025817871094 nb_pixel_total : 86 time to create 1 rle with old method : 0.00012874603271484375 time for calcul the mask position with numpy : 0.00875401496887207 nb_pixel_total : 456 time to create 1 rle with old method : 0.0006830692291259766 time for calcul the mask position with numpy : 0.008471250534057617 nb_pixel_total : 5008 time to create 1 rle with old method : 0.006937980651855469 time for calcul the mask position with numpy : 0.00870513916015625 nb_pixel_total : 1018 time to create 1 rle with old method : 0.0012359619140625 time for calcul the mask position with numpy : 0.008421897888183594 nb_pixel_total : 220 time to create 1 rle with old method : 0.00027298927307128906 time for calcul the mask position with numpy : 0.008417367935180664 nb_pixel_total : 47 time to create 1 rle with old method : 6.794929504394531e-05 time for calcul the mask position with numpy : 0.00843358039855957 nb_pixel_total : 984 time to create 1 rle with old method : 0.001173257827758789 time for calcul the mask position with numpy : 0.008628129959106445 nb_pixel_total : 1191 time to create 1 rle with old method : 0.0014224052429199219 time for calcul the mask position with numpy : 0.008406400680541992 nb_pixel_total : 164 time to create 1 rle with old method : 0.00021266937255859375 time for calcul the mask position with numpy : 0.008398056030273438 nb_pixel_total : 112 time to create 1 rle with old method : 0.0001404285430908203 time for calcul the mask position with numpy : 0.008709907531738281 nb_pixel_total : 852 time to create 1 rle with old method : 0.0010418891906738281 time for calcul the mask position with numpy : 0.008395195007324219 nb_pixel_total : 377 time to create 1 rle with old method : 0.0004711151123046875 time for calcul the mask position with numpy : 0.008388042449951172 nb_pixel_total : 1472 time to create 1 rle with old method : 0.001682281494140625 time for calcul the mask position with numpy : 0.008414745330810547 nb_pixel_total : 42 time to create 1 rle with old method : 5.984306335449219e-05 time for calcul the mask position with numpy : 0.008450984954833984 nb_pixel_total : 218 time to create 1 rle with old method : 0.0002694129943847656 time for calcul the mask position with numpy : 0.008389949798583984 nb_pixel_total : 366 time to create 1 rle with old method : 0.0004551410675048828 time for calcul the mask position with numpy : 0.008408546447753906 nb_pixel_total : 243 time to create 1 rle with old method : 0.0002999305725097656 time for calcul the mask position with numpy : 0.008426189422607422 nb_pixel_total : 126 time to create 1 rle with old method : 0.00016927719116210938 create new chi : 2.4430198669433594 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.006806135177612305 batch 1 Loaded 144 chid ids of type : 4230 Number RLEs to save : 13884 TO DO : save crop sub photo not yet done ! save time : 5.692819356918335 nb_obj : 127 nb_hashtags : 8 time to prepare the origin masks : 2.797990560531616 time for calcul the mask position with numpy : 0.03429841995239258 nb_pixel_total : 1662810 time to create 1 rle with new method : 0.06437182426452637 time for calcul the mask position with numpy : 0.010335922241210938 nb_pixel_total : 111 time to create 1 rle with old method : 0.0001595020294189453 time for calcul the mask position with numpy : 0.006353855133056641 nb_pixel_total : 166 time to create 1 rle with old method : 0.00021982192993164062 time for calcul the mask position with numpy : 0.006520986557006836 nb_pixel_total : 2193 time to create 1 rle with old method : 0.002608776092529297 time for calcul the mask position with numpy : 0.006585836410522461 nb_pixel_total : 12194 time to create 1 rle with old method : 0.013475418090820312 time for calcul the mask position with numpy : 0.0071048736572265625 nb_pixel_total : 2809 time to create 1 rle with old method : 0.0034110546112060547 time for calcul the mask position with numpy : 0.006752729415893555 nb_pixel_total : 3794 time to create 1 rle with old method : 0.00475621223449707 time for calcul the mask position with numpy : 0.007983922958374023 nb_pixel_total : 187 time to create 1 rle with old method : 0.00026297569274902344 time for calcul the mask position with numpy : 0.008714437484741211 nb_pixel_total : 1813 time to create 1 rle with old method : 0.0023097991943359375 time for calcul the mask position with numpy : 0.007677316665649414 nb_pixel_total : 888 time to create 1 rle with old method : 0.001176595687866211 time for calcul the mask position with numpy : 0.007068157196044922 nb_pixel_total : 14 time to create 1 rle with old method : 5.650520324707031e-05 time for calcul the mask position with numpy : 0.006875276565551758 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003311634063720703 time for calcul the mask position with numpy : 0.00731658935546875 nb_pixel_total : 80 time to create 1 rle with old method : 0.00012063980102539062 time for calcul the mask position with numpy : 0.007393836975097656 nb_pixel_total : 973 time to create 1 rle with old method : 0.0013551712036132812 time for calcul the mask position with numpy : 0.007091045379638672 nb_pixel_total : 215 time to create 1 rle with old method : 0.00032711029052734375 time for calcul the mask position with numpy : 0.011658906936645508 nb_pixel_total : 1639 time to create 1 rle with old method : 0.0021865367889404297 time for calcul the mask position with numpy : 0.010303020477294922 nb_pixel_total : 18348 time to create 1 rle with old method : 0.020713090896606445 time for calcul the mask position with numpy : 0.011881828308105469 nb_pixel_total : 2014 time to create 1 rle with old method : 0.002371072769165039 time for calcul the mask position with numpy : 0.011951208114624023 nb_pixel_total : 561 time to create 1 rle with old method : 0.0006995201110839844 time for calcul the mask position with numpy : 0.010348081588745117 nb_pixel_total : 70 time to create 1 rle with old method : 0.0001354217529296875 time for calcul the mask position with numpy : 0.012174606323242188 nb_pixel_total : 202 time to create 1 rle with old method : 0.00034880638122558594 time for calcul the mask position with numpy : 0.011612176895141602 nb_pixel_total : 347 time to create 1 rle with old method : 0.0005867481231689453 time for calcul the mask position with numpy : 0.011702537536621094 nb_pixel_total : 520 time to create 1 rle with old method : 0.0009853839874267578 time for calcul the mask position with numpy : 0.012042999267578125 nb_pixel_total : 613 time to create 1 rle with old method : 0.0010921955108642578 time for calcul the mask position with numpy : 0.010123014450073242 nb_pixel_total : 1557 time to create 1 rle with old method : 0.002523183822631836 time for calcul the mask position with numpy : 0.007395267486572266 nb_pixel_total : 3554 time to create 1 rle with old method : 0.005692720413208008 time for calcul the mask position with numpy : 0.007880926132202148 nb_pixel_total : 6644 time to create 1 rle with old method : 0.007511138916015625 time for calcul the mask position with numpy : 0.0073394775390625 nb_pixel_total : 718 time to create 1 rle with old method : 0.0009026527404785156 time for calcul the mask position with numpy : 0.007904052734375 nb_pixel_total : 1205 time to create 1 rle with old method : 0.0015344619750976562 time for calcul the mask position with numpy : 0.00920248031616211 nb_pixel_total : 91 time to create 1 rle with old method : 0.00013709068298339844 time for calcul the mask position with numpy : 0.007211923599243164 nb_pixel_total : 47 time to create 1 rle with old method : 0.00011658668518066406 time for calcul the mask position with numpy : 0.007540225982666016 nb_pixel_total : 1407 time to create 1 rle with old method : 0.0016241073608398438 time for calcul the mask position with numpy : 0.006708383560180664 nb_pixel_total : 492 time to create 1 rle with old method : 0.0006234645843505859 time for calcul the mask position with numpy : 0.007444858551025391 nb_pixel_total : 151128 time to create 1 rle with new method : 0.034848928451538086 time for calcul the mask position with numpy : 0.00695490837097168 nb_pixel_total : 518 time to create 1 rle with old method : 0.000637054443359375 time for calcul the mask position with numpy : 0.006746530532836914 nb_pixel_total : 450 time to create 1 rle with old method : 0.0005462169647216797 time for calcul the mask position with numpy : 0.006928920745849609 nb_pixel_total : 734 time to create 1 rle with old method : 0.0008974075317382812 time for calcul the mask position with numpy : 0.008677959442138672 nb_pixel_total : 817 time to create 1 rle with old method : 0.0014524459838867188 time for calcul the mask position with numpy : 0.009693384170532227 nb_pixel_total : 17 time to create 1 rle with old method : 7.152557373046875e-05 time for calcul the mask position with numpy : 0.008121967315673828 nb_pixel_total : 797 time to create 1 rle with old method : 0.0009753704071044922 time for calcul the mask position with numpy : 0.007749795913696289 nb_pixel_total : 43 time to create 1 rle with old method : 9.655952453613281e-05 time for calcul the mask position with numpy : 0.006857633590698242 nb_pixel_total : 654 time to create 1 rle with old method : 0.0008020401000976562 time for calcul the mask position with numpy : 0.007160663604736328 nb_pixel_total : 2313 time to create 1 rle with old method : 0.0026276111602783203 time for calcul the mask position with numpy : 0.006941080093383789 nb_pixel_total : 1188 time to create 1 rle with old method : 0.0014140605926513672 time for calcul the mask position with numpy : 0.00677037239074707 nb_pixel_total : 530 time to create 1 rle with old method : 0.0006437301635742188 time for calcul the mask position with numpy : 0.006590127944946289 nb_pixel_total : 281 time to create 1 rle with old method : 0.00037550926208496094 time for calcul the mask position with numpy : 0.006891489028930664 nb_pixel_total : 7450 time to create 1 rle with old method : 0.008512020111083984 time for calcul the mask position with numpy : 0.007069587707519531 nb_pixel_total : 314 time to create 1 rle with old method : 0.00040912628173828125 time for calcul the mask position with numpy : 0.00740361213684082 nb_pixel_total : 3805 time to create 1 rle with old method : 0.004340410232543945 time for calcul the mask position with numpy : 0.0070497989654541016 nb_pixel_total : 73 time to create 1 rle with old method : 0.00013709068298339844 time for calcul the mask position with numpy : 0.007076740264892578 nb_pixel_total : 1100 time to create 1 rle with old method : 0.0012798309326171875 time for calcul the mask position with numpy : 0.0072193145751953125 nb_pixel_total : 6306 time to create 1 rle with old method : 0.007409811019897461 time for calcul the mask position with numpy : 0.007391452789306641 nb_pixel_total : 94 time to create 1 rle with old method : 0.00017690658569335938 time for calcul the mask position with numpy : 0.008115053176879883 nb_pixel_total : 48 time to create 1 rle with old method : 0.00012874603271484375 time for calcul the mask position with numpy : 0.007840156555175781 nb_pixel_total : 481 time to create 1 rle with old method : 0.0006430149078369141 time for calcul the mask position with numpy : 0.007635593414306641 nb_pixel_total : 386 time to create 1 rle with old method : 0.00048613548278808594 time for calcul the mask position with numpy : 0.007380247116088867 nb_pixel_total : 1741 time to create 1 rle with old method : 0.0020978450775146484 time for calcul the mask position with numpy : 0.007519960403442383 nb_pixel_total : 255 time to create 1 rle with old method : 0.00032901763916015625 time for calcul the mask position with numpy : 0.006869792938232422 nb_pixel_total : 664 time to create 1 rle with old method : 0.0008144378662109375 time for calcul the mask position with numpy : 0.006787300109863281 nb_pixel_total : 52 time to create 1 rle with old method : 0.0002455711364746094 time for calcul the mask position with numpy : 0.0072574615478515625 nb_pixel_total : 596 time to create 1 rle with old method : 0.0007383823394775391 time for calcul the mask position with numpy : 0.007667064666748047 nb_pixel_total : 524 time to create 1 rle with old method : 0.0006289482116699219 time for calcul the mask position with numpy : 0.0071218013763427734 nb_pixel_total : 12930 time to create 1 rle with old method : 0.014994144439697266 time for calcul the mask position with numpy : 0.0069158077239990234 nb_pixel_total : 1437 time to create 1 rle with old method : 0.0017571449279785156 time for calcul the mask position with numpy : 0.006949663162231445 nb_pixel_total : 257 time to create 1 rle with old method : 0.00032711029052734375 time for calcul the mask position with numpy : 0.008100032806396484 nb_pixel_total : 39 time to create 1 rle with old method : 8.153915405273438e-05 time for calcul the mask position with numpy : 0.007756471633911133 nb_pixel_total : 10 time to create 1 rle with old method : 5.7697296142578125e-05 time for calcul the mask position with numpy : 0.007845878601074219 nb_pixel_total : 327 time to create 1 rle with old method : 0.00043511390686035156 time for calcul the mask position with numpy : 0.009476900100708008 nb_pixel_total : 96 time to create 1 rle with old method : 0.00016570091247558594 time for calcul the mask position with numpy : 0.007357358932495117 nb_pixel_total : 1730 time to create 1 rle with old method : 0.002008199691772461 time for calcul the mask position with numpy : 0.0070073604583740234 nb_pixel_total : 331 time to create 1 rle with old method : 0.00040411949157714844 time for calcul the mask position with numpy : 0.006504058837890625 nb_pixel_total : 477 time to create 1 rle with old method : 0.0005815029144287109 time for calcul the mask position with numpy : 0.006861686706542969 nb_pixel_total : 28 time to create 1 rle with old method : 7.2479248046875e-05 time for calcul the mask position with numpy : 0.006471872329711914 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002269744873046875 time for calcul the mask position with numpy : 0.006670475006103516 nb_pixel_total : 146 time to create 1 rle with old method : 0.00019049644470214844 time for calcul the mask position with numpy : 0.0064694881439208984 nb_pixel_total : 591 time to create 1 rle with old method : 0.0008761882781982422 time for calcul the mask position with numpy : 0.007975578308105469 nb_pixel_total : 106754 time to create 1 rle with old method : 0.12057757377624512 time for calcul the mask position with numpy : 0.006464481353759766 nb_pixel_total : 273 time to create 1 rle with old method : 0.0003619194030761719 time for calcul the mask position with numpy : 0.0072667598724365234 nb_pixel_total : 1656 time to create 1 rle with old method : 0.001988649368286133 time for calcul the mask position with numpy : 0.006735324859619141 nb_pixel_total : 291 time to create 1 rle with old method : 0.0004439353942871094 time for calcul the mask position with numpy : 0.007615804672241211 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003733634948730469 time for calcul the mask position with numpy : 0.007776498794555664 nb_pixel_total : 518 time to create 1 rle with old method : 0.0007650852203369141 time for calcul the mask position with numpy : 0.013267755508422852 nb_pixel_total : 1417 time to create 1 rle with old method : 0.0020682811737060547 time for calcul the mask position with numpy : 0.006963968276977539 nb_pixel_total : 560 time to create 1 rle with old method : 0.0007021427154541016 time for calcul the mask position with numpy : 0.007436990737915039 nb_pixel_total : 174 time to create 1 rle with old method : 0.00021529197692871094 time for calcul the mask position with numpy : 0.006640434265136719 nb_pixel_total : 107 time to create 1 rle with old method : 0.00015282630920410156 time for calcul the mask position with numpy : 0.006455183029174805 nb_pixel_total : 467 time to create 1 rle with old method : 0.0005481243133544922 time for calcul the mask position with numpy : 0.007624626159667969 nb_pixel_total : 448 time to create 1 rle with old method : 0.000553131103515625 time for calcul the mask position with numpy : 0.00677180290222168 nb_pixel_total : 185 time to create 1 rle with old method : 0.00024890899658203125 time for calcul the mask position with numpy : 0.00782465934753418 nb_pixel_total : 212 time to create 1 rle with old method : 0.0002856254577636719 time for calcul the mask position with numpy : 0.006569862365722656 nb_pixel_total : 9751 time to create 1 rle with old method : 0.011214494705200195 time for calcul the mask position with numpy : 0.007136344909667969 nb_pixel_total : 2023 time to create 1 rle with old method : 0.0023169517517089844 time for calcul the mask position with numpy : 0.0069882869720458984 nb_pixel_total : 742 time to create 1 rle with old method : 0.0010423660278320312 time for calcul the mask position with numpy : 0.0071773529052734375 nb_pixel_total : 48 time to create 1 rle with old method : 0.00010418891906738281 time for calcul the mask position with numpy : 0.006917715072631836 nb_pixel_total : 280 time to create 1 rle with old method : 0.00039076805114746094 time for calcul the mask position with numpy : 0.00720524787902832 nb_pixel_total : 114 time to create 1 rle with old method : 0.00024580955505371094 time for calcul the mask position with numpy : 0.006972789764404297 nb_pixel_total : 393 time to create 1 rle with old method : 0.0005855560302734375 time for calcul the mask position with numpy : 0.008302927017211914 nb_pixel_total : 455 time to create 1 rle with old method : 0.0006356239318847656 time for calcul the mask position with numpy : 0.007581472396850586 nb_pixel_total : 507 time to create 1 rle with old method : 0.0006194114685058594 time for calcul the mask position with numpy : 0.007063865661621094 nb_pixel_total : 160 time to create 1 rle with old method : 0.0002307891845703125 time for calcul the mask position with numpy : 0.007036685943603516 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003669261932373047 time for calcul the mask position with numpy : 0.0070552825927734375 nb_pixel_total : 527 time to create 1 rle with old method : 0.0006573200225830078 time for calcul the mask position with numpy : 0.0067670345306396484 nb_pixel_total : 282 time to create 1 rle with old method : 0.00044798851013183594 time for calcul the mask position with numpy : 0.007130622863769531 nb_pixel_total : 149 time to create 1 rle with old method : 0.00020360946655273438 time for calcul the mask position with numpy : 0.006645679473876953 nb_pixel_total : 2 time to create 1 rle with old method : 2.6464462280273438e-05 time for calcul the mask position with numpy : 0.007500410079956055 nb_pixel_total : 213 time to create 1 rle with old method : 0.0003445148468017578 time for calcul the mask position with numpy : 0.007783412933349609 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003688335418701172 time for calcul the mask position with numpy : 0.006422758102416992 nb_pixel_total : 522 time to create 1 rle with old method : 0.0006754398345947266 time for calcul the mask position with numpy : 0.006681680679321289 nb_pixel_total : 74 time to create 1 rle with old method : 0.00014781951904296875 time for calcul the mask position with numpy : 0.008032083511352539 nb_pixel_total : 139 time to create 1 rle with old method : 0.0002486705780029297 time for calcul the mask position with numpy : 0.007377147674560547 nb_pixel_total : 4927 time to create 1 rle with old method : 0.005833864212036133 time for calcul the mask position with numpy : 0.006707906723022461 nb_pixel_total : 1489 time to create 1 rle with old method : 0.0018846988677978516 time for calcul the mask position with numpy : 0.007814884185791016 nb_pixel_total : 1009 time to create 1 rle with old method : 0.001252889633178711 time for calcul the mask position with numpy : 0.006944179534912109 nb_pixel_total : 691 time to create 1 rle with old method : 0.0008866786956787109 time for calcul the mask position with numpy : 0.00729060173034668 nb_pixel_total : 17 time to create 1 rle with old method : 0.00010538101196289062 time for calcul the mask position with numpy : 0.0067806243896484375 nb_pixel_total : 11 time to create 1 rle with old method : 3.647804260253906e-05 time for calcul the mask position with numpy : 0.00656890869140625 nb_pixel_total : 56 time to create 1 rle with old method : 0.00011444091796875 time for calcul the mask position with numpy : 0.006928205490112305 nb_pixel_total : 1317 time to create 1 rle with old method : 0.0017299652099609375 time for calcul the mask position with numpy : 0.006937742233276367 nb_pixel_total : 42 time to create 1 rle with old method : 0.00012445449829101562 time for calcul the mask position with numpy : 0.007088899612426758 nb_pixel_total : 209 time to create 1 rle with old method : 0.0003063678741455078 time for calcul the mask position with numpy : 0.0061931610107421875 nb_pixel_total : 115 time to create 1 rle with old method : 0.00016260147094726562 time for calcul the mask position with numpy : 0.00672149658203125 nb_pixel_total : 881 time to create 1 rle with old method : 0.0013661384582519531 time for calcul the mask position with numpy : 0.006575107574462891 nb_pixel_total : 27 time to create 1 rle with old method : 6.580352783203125e-05 time for calcul the mask position with numpy : 0.0061757564544677734 nb_pixel_total : 132 time to create 1 rle with old method : 0.00018215179443359375 time for calcul the mask position with numpy : 0.0062143802642822266 nb_pixel_total : 4 time to create 1 rle with old method : 4.792213439941406e-05 time for calcul the mask position with numpy : 0.0062830448150634766 nb_pixel_total : 1550 time to create 1 rle with old method : 0.0018529891967773438 time for calcul the mask position with numpy : 0.00709080696105957 nb_pixel_total : 229 time to create 1 rle with old method : 0.0003483295440673828 time for calcul the mask position with numpy : 0.0071413516998291016 nb_pixel_total : 279 time to create 1 rle with old method : 0.00034236907958984375 create new chi : 1.4130983352661133 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0018377304077148438 batch 1 Loaded 128 chid ids of type : 4230 Number RLEs to save : 12090 TO DO : save crop sub photo not yet done ! save time : 2.7952120304107666 map_output_result : {1335300557: (0.0, 'Should be the crop_list due to order', 0.0), 1335300528: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1335300557, 1335300528] Looping around the photos to save general results len do output : 2 /1335300557.Didn't retrieve data . /1335300528.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2560841') ('4234', '20313888', '1335300557', None, None, None, None, None, '2560841') ('4234', None, None, None, None, None, None, None, '2560841') ('4234', '20313888', '1335300528', None, None, None, None, None, '2560841') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.015897274017333984 save_final save missing photos in datou_result : time spend for datou_step_exec : 17.02306056022644 time spend to save output : 0.016170978546142578 total time spend for step 4 : 17.039231538772583 step5:crop_condition Fri Feb 7 06:21:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 2 ! batch 1 Loaded 272 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 80 About to insert : list_path_to_insert length 80 new photo from crops ! About to upload 80 photos upload in portfolio : 4869462 init cache_photo without model_param we have 80 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738905679_2060708 we have uploaded 80 photos in the portfolio 4869462 time of upload the photos Elapsed time : 20.296157360076904 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 40 About to insert : list_path_to_insert length 40 new photo from crops ! About to upload 40 photos upload in portfolio : 4869462 init cache_photo without model_param we have 40 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738905700_2060708 we have uploaded 40 photos in the portfolio 4869462 time of upload the photos Elapsed time : 10.265857696533203 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738905710_2060708 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.628159761428833 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 4869462 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738905711_2060708 we have uploaded 11 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.3217098712921143 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 43 About to insert : list_path_to_insert length 43 new photo from crops ! About to upload 43 photos upload in portfolio : 4869462 init cache_photo without model_param we have 43 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738905715_2060708 we have uploaded 43 photos in the portfolio 4869462 time of upload the photos Elapsed time : 9.775524139404297 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738905725_2060708 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.589038610458374 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1335300557, 1335300528] Looping around the photos to save general results len do output : 177 /1335410676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335410956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2560841') ('4234', '20313888', '1335300557', None, None, None, None, None, '2560841') ('4234', None, None, None, None, None, None, None, '2560841') ('4234', '20313888', '1335300528', None, None, None, None, None, '2560841') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 533 time used for this insertion : 0.15244412422180176 save_final save missing photos in datou_result : time spend for datou_step_exec : 49.16788673400879 time spend to save output : 0.15799736976623535 total time spend for step 5 : 49.325884103775024 step6:thcl Fri Feb 7 06:22:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.00707697868347168 time to convert the images to numpy array : 0.031424522399902344 time to import caffe and check if the image exist : 0.008807182312011719 time to convert the images to numpy array : 0.033124446868896484 time to import caffe and check if the image exist : 0.010255098342895508 time to convert the images to numpy array : 0.03769207000732422 time to import caffe and check if the image exist : 0.011899471282958984 time to convert the images to numpy array : 0.03813004493713379 time to import caffe and check if the image exist : 0.011493682861328125 time to convert the images to numpy array : 0.04030036926269531 time to import caffe and check if the image exist : 0.014986276626586914 time to convert the images to numpy array : 0.03768348693847656 time to import caffe and check if the image exist : 0.018911361694335938 time to convert the images to numpy array : 0.03351187705993652 time to import caffe and check if the image exist : 0.01627373695373535 time to convert the images to numpy array : 0.036850929260253906 time to import caffe and check if the image exist : 0.011910200119018555 time to convert the images to numpy array : 0.04354286193847656 time to import caffe and check if the image exist : 0.008223533630371094 time to convert the images to numpy array : 0.04735207557678223 total time to convert the images to numpy array : 0.2672731876373291 list photo_ids error: [] list photo_ids correct : [1335410732, 1335410733, 1335410734, 1335410735, 1335410736, 1335410737, 1335410738, 1335410739, 1335410740, 1335410741, 1335410742, 1335410743, 1335410744, 1335410745, 1335410746, 1335410747, 1335410748, 1335410749, 1335410942, 1335410943, 1335410944, 1335410945, 1335410946, 1335410947, 1335410948, 1335410949, 1335410950, 1335410951, 1335410952, 1335410953, 1335410954, 1335410955, 1335410956, 1335410825, 1335410828, 1335410831, 1335410834, 1335410837, 1335410840, 1335410843, 1335410846, 1335410849, 1335410852, 1335410855, 1335410858, 1335410861, 1335410863, 1335410866, 1335410868, 1335410872, 1335410875, 1335410695, 1335410696, 1335410697, 1335410698, 1335410699, 1335410700, 1335410701, 1335410702, 1335410703, 1335410704, 1335410705, 1335410706, 1335410707, 1335410708, 1335410709, 1335410710, 1335410711, 1335410712, 1335410877, 1335410880, 1335410884, 1335410886, 1335410887, 1335410888, 1335410889, 1335410890, 1335410891, 1335410893, 1335410894, 1335410895, 1335410896, 1335410898, 1335410900, 1335410901, 1335410902, 1335410903, 1335410750, 1335410751, 1335410752, 1335410753, 1335410754, 1335410755, 1335410756, 1335410757, 1335410796, 1335410799, 1335410801, 1335410804, 1335410806, 1335410810, 1335410813, 1335410816, 1335410819, 1335410822, 1335410924, 1335410925, 1335410926, 1335410927, 1335410928, 1335410929, 1335410930, 1335410931, 1335410932, 1335410933, 1335410934, 1335410935, 1335410936, 1335410937, 1335410938, 1335410939, 1335410940, 1335410941, 1335410904, 1335410905, 1335410906, 1335410907, 1335410908, 1335410909, 1335410910, 1335410913, 1335410914, 1335410915, 1335410916, 1335410917, 1335410918, 1335410919, 1335410920, 1335410921, 1335410922, 1335410923, 1335410676, 1335410677, 1335410678, 1335410679, 1335410680, 1335410681, 1335410682, 1335410683, 1335410684, 1335410685, 1335410686, 1335410688, 1335410689, 1335410690, 1335410691, 1335410692, 1335410693, 1335410694, 1335410713, 1335410714, 1335410715, 1335410716, 1335410717, 1335410718, 1335410719, 1335410720, 1335410721, 1335410722, 1335410724, 1335410725, 1335410726, 1335410727, 1335410728, 1335410729, 1335410730, 1335410731] number of photos to traite : 177 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4465 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4027 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 0.820073127746582 time used to do the prediction : 0.6388328075408936 save descriptor for thcl : 3237 time to traite the descriptors : 1.0551373958587646 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1335410732 To insert : 1335410733 To insert : 1335410734 To insert : 1335410735 To insert : 1335410736 To insert : 1335410737 To insert : 1335410738 To insert : 1335410739 To insert : 1335410740 To insert : 1335410741 To insert : 1335410742 To insert : 1335410743 To insert : 1335410744 To insert : 1335410745 To insert : 1335410746 To insert : 1335410747 To insert : 1335410748 To insert : 1335410749 To insert : 1335410942 To insert : 1335410943 To insert : 1335410944 To insert : 1335410945 To insert : 1335410946 To insert : 1335410947 To insert : 1335410948 To insert : 1335410949 To insert : 1335410950 To insert : 1335410951 To insert : 1335410952 To insert : 1335410953 To insert : 1335410954 To insert : 1335410955 To insert : 1335410956 To insert : 1335410825 To insert : 1335410828 To insert : 1335410831 To insert : 1335410834 To insert : 1335410837 To insert : 1335410840 To insert : 1335410843 To insert : 1335410846 To insert : 1335410849 To insert : 1335410852 To insert : 1335410855 To insert : 1335410858 To insert : 1335410861 To insert : 1335410863 To insert : 1335410866 To insert : 1335410868 To insert : 1335410872 To insert : 1335410875 To insert : 1335410695 To insert : 1335410696 To insert : 1335410697 To insert : 1335410698 To insert : 1335410699 To insert : 1335410700 To insert : 1335410701 To insert : 1335410702 To insert : 1335410703 To insert : 1335410704 To insert : 1335410705 To insert : 1335410706 To insert : 1335410707 To insert : 1335410708 To insert : 1335410709 To insert : 1335410710 To insert : 1335410711 To insert : 1335410712 To insert : 1335410877 To insert : 1335410880 To insert : 1335410884 To insert : 1335410886 To insert : 1335410887 To insert : 1335410888 To insert : 1335410889 To insert : 1335410890 To insert : 1335410891 To insert : 1335410893 To insert : 1335410894 To insert : 1335410895 To insert : 1335410896 To insert : 1335410898 To insert : 1335410900 To insert : 1335410901 To insert : 1335410902 To insert : 1335410903 To insert : 1335410750 To insert : 1335410751 To insert : 1335410752 To insert : 1335410753 To insert : 1335410754 To insert : 1335410755 To insert : 1335410756 To insert : 1335410757 To insert : 1335410796 To insert : 1335410799 To insert : 1335410801 To insert : 1335410804 To insert : 1335410806 To insert : 1335410810 To insert : 1335410813 To insert : 1335410816 To insert : 1335410819 To insert : 1335410822 To insert : 1335410924 To insert : 1335410925 To insert : 1335410926 To insert : 1335410927 To insert : 1335410928 To insert : 1335410929 To insert : 1335410930 To insert : 1335410931 To insert : 1335410932 To insert : 1335410933 To insert : 1335410934 To insert : 1335410935 To insert : 1335410936 To insert : 1335410937 To insert : 1335410938 To insert : 1335410939 To insert : 1335410940 To insert : 1335410941 To insert : 1335410904 To insert : 1335410905 To insert : 1335410906 To insert : 1335410907 To insert : 1335410908 To insert : 1335410909 To insert : 1335410910 To insert : 1335410913 To insert : 1335410914 To insert : 1335410915 To insert : 1335410916 To insert : 1335410917 To insert : 1335410918 To insert : 1335410919 To insert : 1335410920 To insert : 1335410921 To insert : 1335410922 To insert : 1335410923 To insert : 1335410676 To insert : 1335410677 To insert : 1335410678 To insert : 1335410679 To insert : 1335410680 To insert : 1335410681 To insert : 1335410682 To insert : 1335410683 To insert : 1335410684 To insert : 1335410685 To insert : 1335410686 To insert : 1335410688 To insert : 1335410689 To insert : 1335410690 To insert : 1335410691 To insert : 1335410692 To insert : 1335410693 To insert : 1335410694 To insert : 1335410713 To insert : 1335410714 To insert : 1335410715 To insert : 1335410716 To insert : 1335410717 To insert : 1335410718 To insert : 1335410719 To insert : 1335410720 To insert : 1335410721 To insert : 1335410722 To insert : 1335410724 To insert : 1335410725 To insert : 1335410726 To insert : 1335410727 To insert : 1335410728 To insert : 1335410729 To insert : 1335410730 To insert : 1335410731 time to insert the descriptors : 34.01210165023804 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 262 time used for this insertion : 0.025908231735229492 save missing photos in datou_result : time spend for datou_step_exec : 40.518312215805054 time spend to save output : 0.07758879661560059 total time spend for step 6 : 40.595901012420654 step7:ventilate_hashtags_in_portfolio Fri Feb 7 06:22:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20313888 get user id for portfolio 20313888 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20313888 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','flou','Papier','PEHD','autre','pet_fonce','Tetrapak','pet_clair','pehd','refus','environnement','PET_fonce','Film_plastique','Carton','PET_clair','papier','carton','metal')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20313888 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','flou','Papier','PEHD','autre','pet_fonce','Tetrapak','pet_clair','pehd','refus','environnement','PET_fonce','Film_plastique','Carton','PET_clair','papier','carton','metal')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20313888 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','flou','Papier','PEHD','autre','pet_fonce','Tetrapak','pet_clair','pehd','refus','environnement','PET_fonce','Film_plastique','Carton','PET_clair','papier','carton','metal')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20313888 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','flou','Papier','PEHD','autre','pet_fonce','Tetrapak','pet_clair','pehd','refus','environnement','PET_fonce','Film_plastique','Carton','PET_clair','papier','carton','metal')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20321448,20321449,20321463,20321456,20321452,20321459,20321454,20321462,20321457,20321458,20321460,20321464,20321465?tags=mal_croppe,flou,papier,pehd,autre,pet_fonce,tetrapak,pet_clair,refus,environnement,film_plastique,carton,metal&datou_id_consolidate=4235&port_consolidate=20313888 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1335300557, 1335300528] Looping around the photos to save general results len do output : 1 /20313888. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2560841') ('4234', '20313888', '1335300557', None, None, None, None, None, '2560841') ('4234', None, None, None, None, None, None, None, '2560841') ('4234', '20313888', '1335300528', None, None, None, None, None, '2560841') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.016536474227905273 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.814568042755127 time spend to save output : 0.016829729080200195 total time spend for step 7 : 2.831397771835327 step8:final Fri Feb 7 06:22:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1335300557: ('0.2318917364183339',), 1335300528: ('0.2318917364183339',)} new output for save of step final : {1335300557: ('0.2318917364183339',), 1335300528: ('0.2318917364183339',)} [1335300557, 1335300528] Looping around the photos to save general results len do output : 2 /1335300557.Didn't retrieve data . /1335300528.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2560841') ('4234', '20313888', '1335300557', None, None, None, None, None, '2560841') ('4234', None, None, None, None, None, None, None, '2560841') ('4234', '20313888', '1335300528', None, None, None, None, None, '2560841') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.0143890380859375 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11822295188903809 time spend to save output : 0.014643192291259766 total time spend for step 8 : 0.13286614418029785 step9:velours_tree Fri Feb 7 06:22:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20321448,20321449,20321463,20321456,20321452,20321459,20321454,20321462,20321457,20321458,20321460,20321464,20321465 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20321448 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20321449 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20321463 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20321456 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20321452 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20321459 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20321454 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20321462 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20321457 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20321458 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20321460 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20321464 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20321465 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 177 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [5 4 1 1 1 3 1 3 3 2 4 2 4 4 3 1 5 2 5 3 5 3 4 2 2 4 4 5 5 2 4 2 3 4 2 5 5 5 1 1 4 2 2 2 2 4 2 5 4 1 1 1 1 1 4 2 3 4 4 3 3 4 2 2 4 5 5 5 4 2 4 2 4 4 1 5 5 4 2 2 5 5 1 4 2 2 4 3 3 3 3 5 1 4 4 0 2 2 4 2 2 0 5 1 5 2 4 3 2 2 3 3 5 1 4 0 2 2 2 2 2 2 2 1 1 1 1 2 2 1 2 5 5 0 0 4 0 5 5 4 0 3 5 5 3 3 3 5 5 5 4 5 3 3 5 3 5 0 4 0 3 5 1 3 3 5 3 5 5 5 5 5 3 5 5 3 5] Elapsed time: 0.04000711441040039 graph_id used : 76669 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20321448,20321449,20321463,20321456,20321452,20321459,20321454,20321462,20321457,20321458,20321460,20321464,20321465?tags=mal_croppe,flou,papier,pehd,autre,pet_fonce,tetrapak,pet_clair,refus,environnement,film_plastique,carton,metal&datou_id_consolidate=4235&port_consolidate=20313888&tree_id=76669 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1335300557, 1335300528] Looping around the photos to save general results len do output : 1 /20313888Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2560841') ('4234', '20313888', '1335300557', None, None, None, None, None, '2560841') ('4234', None, None, None, None, None, None, None, '2560841') ('4234', '20313888', '1335300528', None, None, None, None, None, '2560841') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.014796257019042969 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.273270845413208 time spend to save output : 0.015155315399169922 total time spend for step 9 : 15.288426160812378 step10:send_mail_cod Fri Feb 7 06:23:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20313888_07-02-2025_06_23_05.pdf 20321430 imagette203214301738905785 20321431 imagette203214311738905785 20321445 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203214451738905785 20321438 change filename to text .imagette203214381738905786 20321434 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203214341738905786 20321441 imagette203214411738905787 20321436 imagette203214361738905787 20321444 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203214441738905787 20321439 imagette203214391738905787 20321442 imagette203214421738905787 20321446 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette203214461738905787 20321447 change filename to text .change filename to text .imagette203214471738905788 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20313888 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20321448,20321449,20321463,20321456,20321452,20321459,20321454,20321462,20321457,20321458,20321460,20321464,20321465?tags=mal_croppe,flou,papier,pehd,autre,pet_fonce,tetrapak,pet_clair,refus,environnement,film_plastique,carton,metal&datou_id_consolidate=4235&port_consolidate=20313888&tree_id=76669 your option no_mail is active, we will not send the real mail to your client args[1335300557] : ((1335300557, -7.713341034734607, 492609224), (1335300557, -0.550888794807066, 501862349), '0.2318917364183339') apple ((1335300557, -7.713341034734607, 492609224), (1335300557, -0.550888794807066, 501862349), '0.2318917364183339') We are sending mail with results at cod@fotonower.com args[1335300528] : ((1335300528, -7.706642203290832, 492609224), (1335300528, -0.5417490079261164, 501862349), '0.2318917364183339') apple ((1335300528, -7.706642203290832, 492609224), (1335300528, -0.5417490079261164, 501862349), '0.2318917364183339') We are sending mail with results at cod@fotonower.com refus_total : 0.2318917364183339 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20313888 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20313888_07-02-2025_06_23_05.pdf results_Qualipapia_P20313888_07-02-2025_06_23_05.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20313888_07-02-2025_06_23_05.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20313888','results_Qualipapia_P20313888_07-02-2025_06_23_05.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20313888_07-02-2025_06_23_05.pdf','pdf','','0.15','0.2318917364183339') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1335300557, 1335300528] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2560841') ('4234', '20313888', '1335300557', None, None, None, None, None, '2560841') ('4234', None, None, None, None, None, None, None, '2560841') ('4234', '20313888', '1335300528', None, None, None, None, None, '2560841') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.014087438583374023 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.639617443084717 time spend to save output : 0.014264106750488281 total time spend for step 10 : 4.653881549835205 step11:split_time_score Fri Feb 7 06:23:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 2),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 06022025 20313888 Nombre de photos uploadées : 2 / 23040 (0%) 06022025 20313888 Nombre de photos taguées (types de déchets): 2 / 2 (100%) 06022025 20313888 Nombre de photos taguées (volume) : 0 / 2 (0%) elapsed_time : load_data_split_time_score 3.337860107421875e-06 elapsed_time : order_list_meta_photo_and_scores 8.344650268554688e-06 ?? elapsed_time : fill_and_build_computed_from_old_data 0.00023126602172851562 elapsed_time : insert_dashboard_record_day_entry 0.03168773651123047 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20297627 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20297627 order by id desc limit 1 Qualite : 0.1437886216255483 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20297628_06-02-2025_13_32_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20297628 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20297628 AND mptpi.`type`=4230 To do Qualite : 0.1437886216255483 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20297628_06-02-2025_13_32_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20297628 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20297628 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20297629 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20298032 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20298033 order by id desc limit 1 Qualite : 0.1283856179969406 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20298034_06-02-2025_17_41_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20298034 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20298034 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20298035 order by id desc limit 1 Qualite : 0.15398963015225456 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20298036_06-02-2025_18_00_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20298036 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20298036 AND mptpi.`type`=4230 To do Qualite : 0.23439323561320993 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20300744_06-02-2025_18_42_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20300744 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20300744 AND mptpi.`type`=4230 To do Qualite : 0.21397048530398904 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20300745_06-02-2025_18_20_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20300745 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20300745 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20305751 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20305752 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20305753 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20305754 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20305755 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20305780 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20305781 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20305782 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20305783 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20305784 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20305785 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20305786 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20305787 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20305788 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20305789 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20305790 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20311741 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20311742 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20309441 order by id desc limit 1 Qualite : 0.21829823758037809 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20305792_06-02-2025_20_38_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20305792 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20305792 AND mptpi.`type`=4230 To do Qualite : 0.24527143931636783 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20305793_06-02-2025_20_21_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20305793 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20305793 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20309442 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20309443 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20309444 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20309445 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20309446 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20309447 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20309448 order by id desc limit 1 Qualite : 0.20351072599550035 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20307171_06-02-2025_20_48_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20307171 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20307171 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20307172 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20308356 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20308357 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20308358 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20308359 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20308360 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20308361 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20308362 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20308363 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20308364 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20308365 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20308366 order by id desc limit 1 Qualite : 0.186778754333038 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20308367_06-02-2025_21_35_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20308367 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20308367 AND mptpi.`type`=4230 To do Qualite : 0.18142782694266635 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20308368_06-02-2025_21_25_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20308368 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20308368 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20309449 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20309450 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20309451 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20309452 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20309453 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20309454 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20309455 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20309456 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20309457 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20309458 order by id desc limit 1 Qualite : 0.17501760183289164 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20309459_06-02-2025_21_47_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20309459 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20309459 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20311743 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20311744 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20311745 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20310713 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20310714 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20310715 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20310716 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20310717 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20310718 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20310719 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20310720 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20310721 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20310722 order by id desc limit 1 Qualite : 0.18614081699614712 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20310723_06-02-2025_22_46_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20310723 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20310723 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20310724 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20311768 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20311783 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20311784 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20311785 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20311786 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20311787 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20311788 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20311789 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20311790 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20311791 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20311792 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20311793 order by id desc limit 1 Qualite : 0.20198839558319584 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20311794_06-02-2025_23_51_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20311794 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20311794 AND mptpi.`type`=4230 To do Qualite : 0.23592222524593415 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20311795_06-02-2025_23_34_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20311795 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20311795 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20313881 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20313883 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20313885 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20313886 order by id desc limit 1 Qualite : 0.24577866042246174 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20313887_07-02-2025_05_48_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20313887 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20313887 AND mptpi.`type`=4230 To do Qualite : 0.2318917364183339 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20313888_07-02-2025_06_23_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20313888 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20313888 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20313889 order by id desc limit 1 Qualite : 0.23950510200248276 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20313890_07-02-2025_05_10_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20313890 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20313890 AND mptpi.`type`=4230 To do Qualite : 0.24041838710966013 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20313892_07-02-2025_04_33_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20313892 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20313892 AND mptpi.`type`=4230 To do Qualite : 0.23392751387831337 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20313894_07-02-2025_00_43_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20313894 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20313894 AND mptpi.`type`=4230 To do Qualite : 0.22631795928320772 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20313895_07-02-2025_00_49_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20313895 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20313895 AND mptpi.`type`=4230 To do Qualite : 0.240626815629049 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20313896_07-02-2025_04_06_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20313896 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20313896 AND mptpi.`type`=4230 To do Qualite : 0.20958892165571463 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20313897_07-02-2025_00_35_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20313897 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20313897 AND mptpi.`type`=4230 To do Qualite : 0.24353721895156324 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20313898_07-02-2025_00_33_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20313898 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20313898 AND mptpi.`type`=4230 To do Qualite : 0.233141044949768 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20313899_07-02-2025_00_27_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20313899 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20313899 AND mptpi.`type`=4230 To do Qualite : 0.233083818434412 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20313900_07-02-2025_00_22_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20313900 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20313900 AND mptpi.`type`=4230 To do Qualite : 0.2386101662580131 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20313901_07-02-2025_00_19_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20313901 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20313901 AND mptpi.`type`=4230 To do Qualite : 0.22755099009181698 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20314473_07-02-2025_01_19_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20314473 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20314473 AND mptpi.`type`=4230 To do Qualite : 0.2589695579663814 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20314474_07-02-2025_01_22_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20314474 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20314474 AND mptpi.`type`=4230 To do Qualite : 0.19669894780452696 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20314475_07-02-2025_01_14_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20314475 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20314475 AND mptpi.`type`=4230 To do Qualite : 0.23988734533008302 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20314476_07-02-2025_01_19_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20314476 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20314476 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'06022025': {'nb_upload': 2, 'nb_taggue_class': 2, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1335300557, 1335300528] Looping around the photos to save general results len do output : 1 /20313888Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2560841') ('4234', '20313888', '1335300557', None, None, None, None, None, '2560841') ('4234', None, None, None, None, None, None, None, '2560841') ('4234', '20313888', '1335300528', None, None, None, None, None, '2560841') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.04647469520568848 save_final save missing photos in datou_result : time spend for datou_step_exec : 73.80172753334045 time spend to save output : 0.04660773277282715 total time spend for step 11 : 73.84833526611328 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 2 set_done_treatment 36.03user 28.26system 3:58.92elapsed 26%CPU (0avgtext+0avgdata 2591484maxresident)k 816000inputs+13328outputs (820major+2437737minor)pagefaults 0swaps