python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2203966 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2808944'] with mtr_portfolio_ids : ['22803397'] and first list_photo_ids : [] new path : /proc/2203966/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.4176928997039795 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu May 8 22:10:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4330 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-08 22:10:33.749086: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-08 22:10:33.775050: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-08 22:10:33.777180: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fcff8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-08 22:10:33.777245: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-08 22:10:33.781444: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-08 22:10:34.027955: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x444a50c0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-08 22:10:34.028015: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-08 22:10:34.029278: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-08 22:10:34.029729: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-08 22:10:34.033063: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-08 22:10:34.036183: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-08 22:10:34.036724: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-08 22:10:34.040217: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-08 22:10:34.041273: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-08 22:10:34.048038: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-08 22:10:34.049725: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-08 22:10:34.049831: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-08 22:10:34.050736: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-08 22:10:34.050761: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-08 22:10:34.050776: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-08 22:10:34.052291: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3878 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-08 22:10:34.329905: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-08 22:10:34.330054: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-08 22:10:34.330086: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-08 22:10:34.330115: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-08 22:10:34.330144: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-08 22:10:34.330171: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-08 22:10:34.330199: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-08 22:10:34.330227: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-08 22:10:34.331645: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-08 22:10:34.332679: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-08 22:10:34.332724: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-08 22:10:34.332742: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-08 22:10:34.332758: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-08 22:10:34.332774: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-08 22:10:34.332789: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-08 22:10:34.332805: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-08 22:10:34.332821: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-08 22:10:34.333690: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-08 22:10:34.333727: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-08 22:10:34.333735: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-08 22:10:34.333743: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-08 22:10:34.334661: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3878 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-08 22:10:44.656042: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-08 22:10:44.828762: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-08 22:10:46.168758: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.169537: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.96G (3178325504 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.170259: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2860492800 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.171037: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.40G (2574443520 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.171773: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2316999168 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.171817: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-08 22:10:46.172545: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.172566: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-08 22:10:46.180990: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.181069: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-08 22:10:46.181782: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.181811: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-08 22:10:46.189141: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.189216: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-08 22:10:46.189981: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.190013: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-08 22:10:46.225851: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.226020: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-08 22:10:46.227477: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.227547: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-08 22:10:46.235425: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.235507: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-08 22:10:46.236530: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.236560: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-08 22:10:46.274465: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.275173: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.277380: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.278038: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.325705: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.326386: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.328945: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.329618: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.362871: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.363522: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.365455: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.366126: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.373265: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.373934: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.376128: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.376828: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.384544: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.385208: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.387347: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.388028: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.424668: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.425361: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.426010: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.426659: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.431257: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.431898: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.451670: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.452435: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.453088: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.453737: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.466697: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.467354: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.468002: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.468691: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.473407: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.474041: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.479085: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.479718: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.492081: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.492730: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.497026: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.497654: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.498298: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.498987: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.499889: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.500540: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.511180: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.511810: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.512428: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.513029: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.513756: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.514354: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.515039: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.515629: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.530768: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.531423: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.565452: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.565516: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-05-08 22:10:46.566148: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.566794: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.573971: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.574577: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.575226: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.575844: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.584153: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.584788: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.601816: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.602628: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.603437: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.604172: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.608505: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.609163: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.609793: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.610421: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.612260: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.621921: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.622565: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.631897: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.632559: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.633207: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.633817: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.634433: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 22:10:46.635069: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.29G (3531472896 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 24 Detection mask done ! Trying to reset tf kernel 2204464 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2916 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4109 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0019130706787109375 nb_pixel_total : 24277 time to create 1 rle with old method : 0.04394030570983887 length of segment : 251 time for calcul the mask position with numpy : 0.019994020462036133 nb_pixel_total : 485898 time to create 1 rle with new method : 0.11614775657653809 length of segment : 576 time for calcul the mask position with numpy : 0.006036520004272461 nb_pixel_total : 346494 time to create 1 rle with new method : 0.0370638370513916 length of segment : 440 time for calcul the mask position with numpy : 0.0004961490631103516 nb_pixel_total : 21862 time to create 1 rle with old method : 0.03455853462219238 length of segment : 190 time for calcul the mask position with numpy : 0.002312898635864258 nb_pixel_total : 143671 time to create 1 rle with old method : 0.15918374061584473 length of segment : 596 time for calcul the mask position with numpy : 0.0008194446563720703 nb_pixel_total : 57245 time to create 1 rle with old method : 0.06290364265441895 length of segment : 407 time for calcul the mask position with numpy : 0.0005335807800292969 nb_pixel_total : 29646 time to create 1 rle with old method : 0.03455185890197754 length of segment : 224 time for calcul the mask position with numpy : 0.29572629928588867 nb_pixel_total : 1834618 time to create 1 rle with new method : 0.3461778163909912 length of segment : 1574 time for calcul the mask position with numpy : 0.00028014183044433594 nb_pixel_total : 8413 time to create 1 rle with old method : 0.009515762329101562 length of segment : 145 time for calcul the mask position with numpy : 0.0014088153839111328 nb_pixel_total : 85023 time to create 1 rle with old method : 0.09929060935974121 length of segment : 271 time for calcul the mask position with numpy : 0.0010819435119628906 nb_pixel_total : 60355 time to create 1 rle with old method : 0.06469249725341797 length of segment : 417 time for calcul the mask position with numpy : 0.0016469955444335938 nb_pixel_total : 105607 time to create 1 rle with old method : 0.11613655090332031 length of segment : 308 time for calcul the mask position with numpy : 0.0005326271057128906 nb_pixel_total : 30303 time to create 1 rle with old method : 0.03493237495422363 length of segment : 187 time for calcul the mask position with numpy : 0.0003790855407714844 nb_pixel_total : 19628 time to create 1 rle with old method : 0.023851633071899414 length of segment : 152 time for calcul the mask position with numpy : 0.0013852119445800781 nb_pixel_total : 64457 time to create 1 rle with old method : 0.10121583938598633 length of segment : 243 time for calcul the mask position with numpy : 0.0009179115295410156 nb_pixel_total : 24278 time to create 1 rle with old method : 0.027825355529785156 length of segment : 183 time for calcul the mask position with numpy : 0.0018947124481201172 nb_pixel_total : 113907 time to create 1 rle with old method : 0.12906551361083984 length of segment : 358 time for calcul the mask position with numpy : 0.002683877944946289 nb_pixel_total : 107801 time to create 1 rle with old method : 0.12399053573608398 length of segment : 531 time for calcul the mask position with numpy : 0.0017766952514648438 nb_pixel_total : 72961 time to create 1 rle with old method : 0.08420753479003906 length of segment : 668 time for calcul the mask position with numpy : 0.0005128383636474609 nb_pixel_total : 21208 time to create 1 rle with old method : 0.02542734146118164 length of segment : 184 time for calcul the mask position with numpy : 0.0031235218048095703 nb_pixel_total : 138142 time to create 1 rle with old method : 0.1584300994873047 length of segment : 548 time for calcul the mask position with numpy : 0.0052373409271240234 nb_pixel_total : 243815 time to create 1 rle with new method : 0.01147007942199707 length of segment : 878 time for calcul the mask position with numpy : 0.0038111209869384766 nb_pixel_total : 194476 time to create 1 rle with new method : 0.005593538284301758 length of segment : 740 time for calcul the mask position with numpy : 0.00047969818115234375 nb_pixel_total : 13880 time to create 1 rle with old method : 0.0159146785736084 length of segment : 125 time for calcul the mask position with numpy : 0.0006358623504638672 nb_pixel_total : 13469 time to create 1 rle with old method : 0.02262425422668457 length of segment : 145 time for calcul the mask position with numpy : 0.003407716751098633 nb_pixel_total : 96530 time to create 1 rle with old method : 0.12472748756408691 length of segment : 501 time for calcul the mask position with numpy : 0.0005736351013183594 nb_pixel_total : 17232 time to create 1 rle with old method : 0.019941091537475586 length of segment : 172 time for calcul the mask position with numpy : 0.0010149478912353516 nb_pixel_total : 28873 time to create 1 rle with old method : 0.0475316047668457 length of segment : 194 time for calcul the mask position with numpy : 0.00021314620971679688 nb_pixel_total : 3913 time to create 1 rle with old method : 0.005560874938964844 length of segment : 58 time for calcul the mask position with numpy : 0.0006136894226074219 nb_pixel_total : 12570 time to create 1 rle with old method : 0.014740467071533203 length of segment : 216 time for calcul the mask position with numpy : 0.0005736351013183594 nb_pixel_total : 17998 time to create 1 rle with old method : 0.021163225173950195 length of segment : 124 time for calcul the mask position with numpy : 0.00045609474182128906 nb_pixel_total : 9435 time to create 1 rle with old method : 0.01145315170288086 length of segment : 121 time for calcul the mask position with numpy : 0.000370025634765625 nb_pixel_total : 9209 time to create 1 rle with old method : 0.011249780654907227 length of segment : 105 time for calcul the mask position with numpy : 0.0006816387176513672 nb_pixel_total : 20135 time to create 1 rle with old method : 0.02316451072692871 length of segment : 150 time for calcul the mask position with numpy : 0.0010974407196044922 nb_pixel_total : 32331 time to create 1 rle with old method : 0.03882169723510742 length of segment : 355 time for calcul the mask position with numpy : 0.00041556358337402344 nb_pixel_total : 9762 time to create 1 rle with old method : 0.011991500854492188 length of segment : 110 time for calcul the mask position with numpy : 0.00028777122497558594 nb_pixel_total : 10203 time to create 1 rle with old method : 0.012296915054321289 length of segment : 152 time for calcul the mask position with numpy : 0.0008673667907714844 nb_pixel_total : 24378 time to create 1 rle with old method : 0.029851436614990234 length of segment : 187 time for calcul the mask position with numpy : 0.004250764846801758 nb_pixel_total : 125335 time to create 1 rle with old method : 0.14498543739318848 length of segment : 500 time for calcul the mask position with numpy : 0.001123666763305664 nb_pixel_total : 36465 time to create 1 rle with old method : 0.0415804386138916 length of segment : 225 time for calcul the mask position with numpy : 0.0008032321929931641 nb_pixel_total : 20256 time to create 1 rle with old method : 0.02391791343688965 length of segment : 213 time for calcul the mask position with numpy : 0.0028133392333984375 nb_pixel_total : 64402 time to create 1 rle with old method : 0.0764169692993164 length of segment : 385 time for calcul the mask position with numpy : 0.00047707557678222656 nb_pixel_total : 10288 time to create 1 rle with old method : 0.012228727340698242 length of segment : 107 time for calcul the mask position with numpy : 0.0021309852600097656 nb_pixel_total : 55944 time to create 1 rle with old method : 0.0645608901977539 length of segment : 344 time for calcul the mask position with numpy : 0.000537872314453125 nb_pixel_total : 12195 time to create 1 rle with old method : 0.014584541320800781 length of segment : 129 time for calcul the mask position with numpy : 0.00024366378784179688 nb_pixel_total : 3573 time to create 1 rle with old method : 0.0044100284576416016 length of segment : 70 time for calcul the mask position with numpy : 0.0009257793426513672 nb_pixel_total : 18140 time to create 1 rle with old method : 0.021790504455566406 length of segment : 177 time for calcul the mask position with numpy : 0.0007107257843017578 nb_pixel_total : 11652 time to create 1 rle with old method : 0.01352381706237793 length of segment : 138 time for calcul the mask position with numpy : 0.0005548000335693359 nb_pixel_total : 13340 time to create 1 rle with old method : 0.01576519012451172 length of segment : 113 time for calcul the mask position with numpy : 0.004144906997680664 nb_pixel_total : 102979 time to create 1 rle with old method : 0.14259696006774902 length of segment : 635 time for calcul the mask position with numpy : 0.0008630752563476562 nb_pixel_total : 20930 time to create 1 rle with old method : 0.025004863739013672 length of segment : 186 time for calcul the mask position with numpy : 0.0027043819427490234 nb_pixel_total : 51363 time to create 1 rle with old method : 0.060127973556518555 length of segment : 406 time for calcul the mask position with numpy : 0.016330242156982422 nb_pixel_total : 500699 time to create 1 rle with new method : 0.02281665802001953 length of segment : 1099 time for calcul the mask position with numpy : 0.0009131431579589844 nb_pixel_total : 15690 time to create 1 rle with old method : 0.019060134887695312 length of segment : 305 time for calcul the mask position with numpy : 0.0013556480407714844 nb_pixel_total : 31002 time to create 1 rle with old method : 0.03653073310852051 length of segment : 203 time for calcul the mask position with numpy : 0.0007977485656738281 nb_pixel_total : 21502 time to create 1 rle with old method : 0.025760650634765625 length of segment : 169 time for calcul the mask position with numpy : 0.0037190914154052734 nb_pixel_total : 126479 time to create 1 rle with old method : 0.14539456367492676 length of segment : 536 time for calcul the mask position with numpy : 0.0008847713470458984 nb_pixel_total : 19921 time to create 1 rle with old method : 0.023886919021606445 length of segment : 189 time for calcul the mask position with numpy : 0.0004925727844238281 nb_pixel_total : 13276 time to create 1 rle with old method : 0.016211748123168945 length of segment : 91 time for calcul the mask position with numpy : 0.0022504329681396484 nb_pixel_total : 34934 time to create 1 rle with old method : 0.056952714920043945 length of segment : 269 time for calcul the mask position with numpy : 0.0011086463928222656 nb_pixel_total : 20859 time to create 1 rle with old method : 0.027425765991210938 length of segment : 200 time for calcul the mask position with numpy : 0.0011298656463623047 nb_pixel_total : 20733 time to create 1 rle with old method : 0.02333545684814453 length of segment : 311 time for calcul the mask position with numpy : 0.001132965087890625 nb_pixel_total : 26450 time to create 1 rle with old method : 0.031076908111572266 length of segment : 209 time for calcul the mask position with numpy : 0.002616405487060547 nb_pixel_total : 70035 time to create 1 rle with old method : 0.0792233943939209 length of segment : 300 time for calcul the mask position with numpy : 0.0005753040313720703 nb_pixel_total : 10602 time to create 1 rle with old method : 0.012563943862915039 length of segment : 129 time for calcul the mask position with numpy : 0.004426479339599609 nb_pixel_total : 116736 time to create 1 rle with old method : 0.16916227340698242 length of segment : 279 time for calcul the mask position with numpy : 0.002780437469482422 nb_pixel_total : 72414 time to create 1 rle with old method : 0.10223746299743652 length of segment : 409 time for calcul the mask position with numpy : 0.0006892681121826172 nb_pixel_total : 34533 time to create 1 rle with old method : 0.03983950614929199 length of segment : 330 time for calcul the mask position with numpy : 0.0024623870849609375 nb_pixel_total : 101433 time to create 1 rle with old method : 0.1173086166381836 length of segment : 352 time for calcul the mask position with numpy : 0.011879205703735352 nb_pixel_total : 217953 time to create 1 rle with new method : 0.017452239990234375 length of segment : 932 time for calcul the mask position with numpy : 0.0007925033569335938 nb_pixel_total : 15004 time to create 1 rle with old method : 0.018133163452148438 length of segment : 177 time for calcul the mask position with numpy : 0.0004887580871582031 nb_pixel_total : 9294 time to create 1 rle with old method : 0.010895252227783203 length of segment : 159 time for calcul the mask position with numpy : 0.00677037239074707 nb_pixel_total : 245742 time to create 1 rle with new method : 0.01045083999633789 length of segment : 705 time for calcul the mask position with numpy : 0.001331329345703125 nb_pixel_total : 42115 time to create 1 rle with old method : 0.04992532730102539 length of segment : 393 time for calcul the mask position with numpy : 0.0008132457733154297 nb_pixel_total : 14775 time to create 1 rle with old method : 0.02302861213684082 length of segment : 115 time for calcul the mask position with numpy : 0.0008356571197509766 nb_pixel_total : 19121 time to create 1 rle with old method : 0.022697925567626953 length of segment : 171 time for calcul the mask position with numpy : 0.0008149147033691406 nb_pixel_total : 15345 time to create 1 rle with old method : 0.018546581268310547 length of segment : 154 time for calcul the mask position with numpy : 0.0012407302856445312 nb_pixel_total : 20643 time to create 1 rle with old method : 0.024833202362060547 length of segment : 175 time for calcul the mask position with numpy : 0.0009725093841552734 nb_pixel_total : 23495 time to create 1 rle with old method : 0.031024694442749023 length of segment : 200 time for calcul the mask position with numpy : 0.003454446792602539 nb_pixel_total : 52161 time to create 1 rle with old method : 0.07334160804748535 length of segment : 543 time for calcul the mask position with numpy : 0.0022683143615722656 nb_pixel_total : 47476 time to create 1 rle with old method : 0.05357098579406738 length of segment : 262 time for calcul the mask position with numpy : 0.0010290145874023438 nb_pixel_total : 36966 time to create 1 rle with old method : 0.04320549964904785 length of segment : 193 time for calcul the mask position with numpy : 0.00051116943359375 nb_pixel_total : 13250 time to create 1 rle with old method : 0.015242815017700195 length of segment : 120 time for calcul the mask position with numpy : 0.001753091812133789 nb_pixel_total : 50821 time to create 1 rle with old method : 0.05702328681945801 length of segment : 356 time for calcul the mask position with numpy : 0.0018689632415771484 nb_pixel_total : 46456 time to create 1 rle with old method : 0.05304527282714844 length of segment : 345 time for calcul the mask position with numpy : 0.00159454345703125 nb_pixel_total : 40500 time to create 1 rle with old method : 0.04595637321472168 length of segment : 325 time for calcul the mask position with numpy : 0.0007140636444091797 nb_pixel_total : 14092 time to create 1 rle with old method : 0.016214847564697266 length of segment : 196 time for calcul the mask position with numpy : 0.0006949901580810547 nb_pixel_total : 12872 time to create 1 rle with old method : 0.015223264694213867 length of segment : 138 time for calcul the mask position with numpy : 0.00038170814514160156 nb_pixel_total : 7710 time to create 1 rle with old method : 0.009218215942382812 length of segment : 136 time for calcul the mask position with numpy : 0.001028299331665039 nb_pixel_total : 28413 time to create 1 rle with old method : 0.03373456001281738 length of segment : 241 time for calcul the mask position with numpy : 0.0007269382476806641 nb_pixel_total : 14081 time to create 1 rle with old method : 0.01643228530883789 length of segment : 185 time for calcul the mask position with numpy : 0.0019402503967285156 nb_pixel_total : 49102 time to create 1 rle with old method : 0.05614805221557617 length of segment : 232 time for calcul the mask position with numpy : 0.0007281303405761719 nb_pixel_total : 15923 time to create 1 rle with old method : 0.01820206642150879 length of segment : 168 time for calcul the mask position with numpy : 0.002920866012573242 nb_pixel_total : 79362 time to create 1 rle with old method : 0.08907413482666016 length of segment : 363 time for calcul the mask position with numpy : 0.0015649795532226562 nb_pixel_total : 45129 time to create 1 rle with old method : 0.05083489418029785 length of segment : 331 time for calcul the mask position with numpy : 0.0021011829376220703 nb_pixel_total : 70254 time to create 1 rle with old method : 0.08205437660217285 length of segment : 276 time for calcul the mask position with numpy : 0.0007178783416748047 nb_pixel_total : 14820 time to create 1 rle with old method : 0.018358945846557617 length of segment : 176 time for calcul the mask position with numpy : 0.0008645057678222656 nb_pixel_total : 16554 time to create 1 rle with old method : 0.019272327423095703 length of segment : 208 time for calcul the mask position with numpy : 0.0005345344543457031 nb_pixel_total : 11636 time to create 1 rle with old method : 0.013532638549804688 length of segment : 134 time for calcul the mask position with numpy : 0.0034415721893310547 nb_pixel_total : 76077 time to create 1 rle with old method : 0.08694696426391602 length of segment : 427 time for calcul the mask position with numpy : 0.0004754066467285156 nb_pixel_total : 7268 time to create 1 rle with old method : 0.012462139129638672 length of segment : 91 time for calcul the mask position with numpy : 0.0009052753448486328 nb_pixel_total : 14530 time to create 1 rle with old method : 0.0209503173828125 length of segment : 223 time for calcul the mask position with numpy : 0.0005109310150146484 nb_pixel_total : 12532 time to create 1 rle with old method : 0.01487874984741211 length of segment : 101 time for calcul the mask position with numpy : 0.0006859302520751953 nb_pixel_total : 24392 time to create 1 rle with old method : 0.02794933319091797 length of segment : 166 time for calcul the mask position with numpy : 0.004455089569091797 nb_pixel_total : 110945 time to create 1 rle with old method : 0.12743616104125977 length of segment : 426 time for calcul the mask position with numpy : 0.0002465248107910156 nb_pixel_total : 1777 time to create 1 rle with old method : 0.002207040786743164 length of segment : 54 time for calcul the mask position with numpy : 0.010251283645629883 nb_pixel_total : 225556 time to create 1 rle with new method : 0.01664566993713379 length of segment : 901 time for calcul the mask position with numpy : 0.00041675567626953125 nb_pixel_total : 13091 time to create 1 rle with old method : 0.014905929565429688 length of segment : 242 time for calcul the mask position with numpy : 0.0005567073822021484 nb_pixel_total : 11933 time to create 1 rle with old method : 0.014351844787597656 length of segment : 133 time for calcul the mask position with numpy : 0.0005238056182861328 nb_pixel_total : 8146 time to create 1 rle with old method : 0.00961613655090332 length of segment : 180 time for calcul the mask position with numpy : 0.00045800209045410156 nb_pixel_total : 10005 time to create 1 rle with old method : 0.01199650764465332 length of segment : 127 time for calcul the mask position with numpy : 0.0007956027984619141 nb_pixel_total : 8796 time to create 1 rle with old method : 0.010813236236572266 length of segment : 197 time for calcul the mask position with numpy : 0.0004057884216308594 nb_pixel_total : 7512 time to create 1 rle with old method : 0.009203672409057617 length of segment : 123 time for calcul the mask position with numpy : 0.0023131370544433594 nb_pixel_total : 59370 time to create 1 rle with old method : 0.0720205307006836 length of segment : 279 time for calcul the mask position with numpy : 0.0005595684051513672 nb_pixel_total : 15765 time to create 1 rle with old method : 0.018834829330444336 length of segment : 118 time for calcul the mask position with numpy : 0.0006392002105712891 nb_pixel_total : 18261 time to create 1 rle with old method : 0.02104020118713379 length of segment : 152 time for calcul the mask position with numpy : 0.004938364028930664 nb_pixel_total : 159163 time to create 1 rle with new method : 0.009576559066772461 length of segment : 779 time for calcul the mask position with numpy : 0.0023794174194335938 nb_pixel_total : 65035 time to create 1 rle with old method : 0.09588098526000977 length of segment : 215 time for calcul the mask position with numpy : 0.004760265350341797 nb_pixel_total : 190730 time to create 1 rle with new method : 0.009961128234863281 length of segment : 720 time for calcul the mask position with numpy : 0.0004937648773193359 nb_pixel_total : 11878 time to create 1 rle with old method : 0.014144420623779297 length of segment : 142 time for calcul the mask position with numpy : 0.0004127025604248047 nb_pixel_total : 12295 time to create 1 rle with old method : 0.014557838439941406 length of segment : 244 time for calcul the mask position with numpy : 0.006809234619140625 nb_pixel_total : 249318 time to create 1 rle with new method : 0.0122528076171875 length of segment : 794 time for calcul the mask position with numpy : 0.00031638145446777344 nb_pixel_total : 18078 time to create 1 rle with old method : 0.020997285842895508 length of segment : 107 time for calcul the mask position with numpy : 0.0006775856018066406 nb_pixel_total : 4054 time to create 1 rle with old method : 0.005060434341430664 length of segment : 140 time spent for convertir_results : 12.256307363510132 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 124 chid ids of type : 3594 Number RLEs to save : 36984 save missing photos in datou_result : time spend for datou_step_exec : 77.95006704330444 time spend to save output : 2.116891860961914 total time spend for step 1 : 80.06695890426636 step2:crop_condition Thu May 8 22:11:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 124 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 90 About to insert : list_path_to_insert length 90 new photo from crops ! About to upload 90 photos upload in portfolio : 3736932 init cache_photo without model_param we have 90 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746735140_2203966 we have uploaded 90 photos in the portfolio 3736932 time of upload the photos Elapsed time : 22.386347770690918 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3736932 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746735167_2203966 we have uploaded 14 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.344723224639893 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! About to upload 17 photos upload in portfolio : 3736932 init cache_photo without model_param we have 17 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746735181_2203966 we have uploaded 17 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.9564502239227295 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746735186_2203966 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.49285888671875 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746735188_2203966 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8298444747924805 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1357038184, 1357038181, 1357038144, 1357017288, 1357017286, 1357017279, 1357017276, 1357017269] Looping around the photos to save general results len do output : 124 /1357060542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357060859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357038184', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357038181', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357038144', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017288', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017286', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017279', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017276', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017269', None, None, None, None, None, '2808944') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 380 time used for this insertion : 0.027472496032714844 save_final save missing photos in datou_result : time spend for datou_step_exec : 78.14453983306885 time spend to save output : 0.03086996078491211 total time spend for step 2 : 78.17540979385376 step3:rle_unique_nms_with_priority Thu May 8 22:13:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 124 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 6.2831714153289795 time for calcul the mask position with numpy : 0.5994923114776611 nb_pixel_total : 4055551 time to create 1 rle with new method : 0.8397269248962402 time for calcul the mask position with numpy : 0.03177356719970703 nb_pixel_total : 64457 time to create 1 rle with old method : 0.0662083625793457 time for calcul the mask position with numpy : 0.019626855850219727 nb_pixel_total : 19628 time to create 1 rle with old method : 0.021700143814086914 time for calcul the mask position with numpy : 0.02019190788269043 nb_pixel_total : 30303 time to create 1 rle with old method : 0.032781362533569336 time for calcul the mask position with numpy : 0.020661592483520508 nb_pixel_total : 105607 time to create 1 rle with old method : 0.1123659610748291 time for calcul the mask position with numpy : 0.020270109176635742 nb_pixel_total : 41486 time to create 1 rle with old method : 0.04200434684753418 time for calcul the mask position with numpy : 0.01949286460876465 nb_pixel_total : 85023 time to create 1 rle with old method : 0.08915519714355469 time for calcul the mask position with numpy : 0.020596742630004883 nb_pixel_total : 8413 time to create 1 rle with old method : 0.009107351303100586 time for calcul the mask position with numpy : 0.0647118091583252 nb_pixel_total : 1530679 time to create 1 rle with new method : 0.7813308238983154 time for calcul the mask position with numpy : 0.021933555603027344 nb_pixel_total : 29646 time to create 1 rle with old method : 0.03347516059875488 time for calcul the mask position with numpy : 0.022411584854125977 nb_pixel_total : 57245 time to create 1 rle with old method : 0.06305766105651855 time for calcul the mask position with numpy : 0.021542787551879883 nb_pixel_total : 143671 time to create 1 rle with old method : 0.15736937522888184 time for calcul the mask position with numpy : 0.021188735961914062 nb_pixel_total : 21862 time to create 1 rle with old method : 0.023787736892700195 time for calcul the mask position with numpy : 0.02398824691772461 nb_pixel_total : 346494 time to create 1 rle with new method : 0.4153001308441162 time for calcul the mask position with numpy : 0.0240175724029541 nb_pixel_total : 485898 time to create 1 rle with new method : 0.6001594066619873 time for calcul the mask position with numpy : 0.02176070213317871 nb_pixel_total : 24277 time to create 1 rle with old method : 0.026174545288085938 create new chi : 4.380589962005615 time to delete rle : 0.024807453155517578 batch 1 Loaded 32 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 13335 TO DO : save crop sub photo not yet done ! save time : 0.7821662425994873 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 3.379420280456543 time for calcul the mask position with numpy : 0.6266076564788818 nb_pixel_total : 6160722 time to create 1 rle with new method : 1.2039289474487305 time for calcul the mask position with numpy : 0.022037506103515625 nb_pixel_total : 194476 time to create 1 rle with new method : 0.6342978477478027 time for calcul the mask position with numpy : 0.021714448928833008 nb_pixel_total : 241023 time to create 1 rle with new method : 0.46564769744873047 time for calcul the mask position with numpy : 0.022149324417114258 nb_pixel_total : 138142 time to create 1 rle with old method : 0.1617424488067627 time for calcul the mask position with numpy : 0.023398637771606445 nb_pixel_total : 21208 time to create 1 rle with old method : 0.024074792861938477 time for calcul the mask position with numpy : 0.02406144142150879 nb_pixel_total : 72961 time to create 1 rle with old method : 0.08350491523742676 time for calcul the mask position with numpy : 0.03395366668701172 nb_pixel_total : 107801 time to create 1 rle with old method : 0.12633490562438965 time for calcul the mask position with numpy : 0.025801420211791992 nb_pixel_total : 113907 time to create 1 rle with old method : 0.16935157775878906 create new chi : 3.751537561416626 time to delete rle : 0.0014796257019042969 batch 1 Loaded 15 chid ids of type : 3594 +++++++++Number RLEs to save : 9826 TO DO : save crop sub photo not yet done ! save time : 0.5899882316589355 nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 5.11347770690918 time for calcul the mask position with numpy : 0.37288379669189453 nb_pixel_total : 6762950 time to create 1 rle with new method : 0.6009964942932129 time for calcul the mask position with numpy : 0.036611080169677734 nb_pixel_total : 10203 time to create 1 rle with old method : 0.011711359024047852 time for calcul the mask position with numpy : 0.03857707977294922 nb_pixel_total : 9762 time to create 1 rle with old method : 0.011030197143554688 time for calcul the mask position with numpy : 0.02614426612854004 nb_pixel_total : 24081 time to create 1 rle with old method : 0.027550697326660156 time for calcul the mask position with numpy : 0.020557880401611328 nb_pixel_total : 20135 time to create 1 rle with old method : 0.02250385284423828 time for calcul the mask position with numpy : 0.020559310913085938 nb_pixel_total : 9209 time to create 1 rle with old method : 0.010092020034790039 time for calcul the mask position with numpy : 0.021706819534301758 nb_pixel_total : 9435 time to create 1 rle with old method : 0.011769533157348633 time for calcul the mask position with numpy : 0.023151874542236328 nb_pixel_total : 17998 time to create 1 rle with old method : 0.0206449031829834 time for calcul the mask position with numpy : 0.022960186004638672 nb_pixel_total : 12570 time to create 1 rle with old method : 0.014433622360229492 time for calcul the mask position with numpy : 0.023322582244873047 nb_pixel_total : 3913 time to create 1 rle with old method : 0.004656791687011719 time for calcul the mask position with numpy : 0.02472209930419922 nb_pixel_total : 28873 time to create 1 rle with old method : 0.048477888107299805 time for calcul the mask position with numpy : 0.024806737899780273 nb_pixel_total : 17232 time to create 1 rle with old method : 0.02353358268737793 time for calcul the mask position with numpy : 0.02439284324645996 nb_pixel_total : 96530 time to create 1 rle with old method : 0.1126258373260498 time for calcul the mask position with numpy : 0.022787809371948242 nb_pixel_total : 13469 time to create 1 rle with old method : 0.015490531921386719 time for calcul the mask position with numpy : 0.020943164825439453 nb_pixel_total : 13880 time to create 1 rle with old method : 0.015187740325927734 create new chi : 1.715331792831421 time to delete rle : 0.0010385513305664062 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 7096 TO DO : save crop sub photo not yet done ! save time : 0.44673681259155273 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 5.505197763442993 time for calcul the mask position with numpy : 0.7417242527008057 nb_pixel_total : 6479000 time to create 1 rle with new method : 0.736530065536499 time for calcul the mask position with numpy : 0.022913694381713867 nb_pixel_total : 51363 time to create 1 rle with old method : 0.07243919372558594 time for calcul the mask position with numpy : 0.022837162017822266 nb_pixel_total : 20930 time to create 1 rle with old method : 0.029719829559326172 time for calcul the mask position with numpy : 0.02259063720703125 nb_pixel_total : 102979 time to create 1 rle with old method : 0.11519718170166016 time for calcul the mask position with numpy : 0.02158069610595703 nb_pixel_total : 13340 time to create 1 rle with old method : 0.01517629623413086 time for calcul the mask position with numpy : 0.020924091339111328 nb_pixel_total : 11652 time to create 1 rle with old method : 0.013003110885620117 time for calcul the mask position with numpy : 0.020581960678100586 nb_pixel_total : 18140 time to create 1 rle with old method : 0.02044677734375 time for calcul the mask position with numpy : 0.02201986312866211 nb_pixel_total : 3573 time to create 1 rle with old method : 0.004806995391845703 time for calcul the mask position with numpy : 0.02214193344116211 nb_pixel_total : 12195 time to create 1 rle with old method : 0.013489723205566406 time for calcul the mask position with numpy : 0.02205681800842285 nb_pixel_total : 55944 time to create 1 rle with old method : 0.06261610984802246 time for calcul the mask position with numpy : 0.02182769775390625 nb_pixel_total : 10288 time to create 1 rle with old method : 0.011802196502685547 time for calcul the mask position with numpy : 0.021175384521484375 nb_pixel_total : 64402 time to create 1 rle with old method : 0.07361030578613281 time for calcul the mask position with numpy : 0.021188020706176758 nb_pixel_total : 20256 time to create 1 rle with old method : 0.022790908813476562 time for calcul the mask position with numpy : 0.0216066837310791 nb_pixel_total : 36465 time to create 1 rle with old method : 0.055433034896850586 time for calcul the mask position with numpy : 0.025615453720092773 nb_pixel_total : 125335 time to create 1 rle with old method : 0.14057135581970215 time for calcul the mask position with numpy : 0.022266149520874023 nb_pixel_total : 24378 time to create 1 rle with old method : 0.027837276458740234 create new chi : 2.530839681625366 time to delete rle : 0.0014307498931884766 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 9790 TO DO : save crop sub photo not yet done ! save time : 0.6129777431488037 nb_obj : 23 nb_hashtags : 3 time to prepare the origin masks : 7.9267542362213135 time for calcul the mask position with numpy : 0.8260269165039062 nb_pixel_total : 5307965 time to create 1 rle with new method : 0.6877305507659912 time for calcul the mask position with numpy : 0.020147085189819336 nb_pixel_total : 14775 time to create 1 rle with old method : 0.016066789627075195 time for calcul the mask position with numpy : 0.020539045333862305 nb_pixel_total : 42114 time to create 1 rle with old method : 0.04573678970336914 time for calcul the mask position with numpy : 0.02184128761291504 nb_pixel_total : 245742 time to create 1 rle with new method : 0.5680034160614014 time for calcul the mask position with numpy : 0.02169966697692871 nb_pixel_total : 9294 time to create 1 rle with old method : 0.01033926010131836 time for calcul the mask position with numpy : 0.021039247512817383 nb_pixel_total : 15004 time to create 1 rle with old method : 0.01703667640686035 time for calcul the mask position with numpy : 0.022347211837768555 nb_pixel_total : 217953 time to create 1 rle with new method : 0.6161215305328369 time for calcul the mask position with numpy : 0.02130579948425293 nb_pixel_total : 101433 time to create 1 rle with old method : 0.10949230194091797 time for calcul the mask position with numpy : 0.021757125854492188 nb_pixel_total : 2371 time to create 1 rle with old method : 0.0028581619262695312 time for calcul the mask position with numpy : 0.02132391929626465 nb_pixel_total : 72414 time to create 1 rle with old method : 0.07877659797668457 time for calcul the mask position with numpy : 0.021656513214111328 nb_pixel_total : 116736 time to create 1 rle with old method : 0.12602496147155762 time for calcul the mask position with numpy : 0.020987272262573242 nb_pixel_total : 10602 time to create 1 rle with old method : 0.011632919311523438 time for calcul the mask position with numpy : 0.021486759185791016 nb_pixel_total : 62292 time to create 1 rle with old method : 0.07799553871154785 time for calcul the mask position with numpy : 0.024313926696777344 nb_pixel_total : 26450 time to create 1 rle with old method : 0.03493165969848633 time for calcul the mask position with numpy : 0.021853208541870117 nb_pixel_total : 20733 time to create 1 rle with old method : 0.023009061813354492 time for calcul the mask position with numpy : 0.02075815200805664 nb_pixel_total : 20859 time to create 1 rle with old method : 0.022413015365600586 time for calcul the mask position with numpy : 0.02105998992919922 nb_pixel_total : 34934 time to create 1 rle with old method : 0.03746914863586426 time for calcul the mask position with numpy : 0.02039313316345215 nb_pixel_total : 13276 time to create 1 rle with old method : 0.014263629913330078 time for calcul the mask position with numpy : 0.020596742630004883 nb_pixel_total : 19921 time to create 1 rle with old method : 0.021088838577270508 time for calcul the mask position with numpy : 0.021797895431518555 nb_pixel_total : 126479 time to create 1 rle with old method : 0.13866639137268066 time for calcul the mask position with numpy : 0.02182149887084961 nb_pixel_total : 21502 time to create 1 rle with old method : 0.025830745697021484 time for calcul the mask position with numpy : 0.022184133529663086 nb_pixel_total : 31002 time to create 1 rle with old method : 0.03449392318725586 time for calcul the mask position with numpy : 0.021490097045898438 nb_pixel_total : 15690 time to create 1 rle with old method : 0.017695903778076172 time for calcul the mask position with numpy : 0.027536869049072266 nb_pixel_total : 500699 time to create 1 rle with new method : 0.6589090824127197 create new chi : 4.8285346031188965 time to delete rle : 0.002276182174682617 batch 1 Loaded 47 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++Number RLEs to save : 17274 TO DO : save crop sub photo not yet done ! save time : 1.0082013607025146 nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 6.641301155090332 time for calcul the mask position with numpy : 0.7722983360290527 nb_pixel_total : 6621078 time to create 1 rle with new method : 0.9018714427947998 time for calcul the mask position with numpy : 0.021079063415527344 nb_pixel_total : 28413 time to create 1 rle with old method : 0.03293728828430176 time for calcul the mask position with numpy : 0.022394180297851562 nb_pixel_total : 7551 time to create 1 rle with old method : 0.008625984191894531 time for calcul the mask position with numpy : 0.02139878273010254 nb_pixel_total : 12872 time to create 1 rle with old method : 0.014523506164550781 time for calcul the mask position with numpy : 0.021826505661010742 nb_pixel_total : 14092 time to create 1 rle with old method : 0.0160524845123291 time for calcul the mask position with numpy : 0.022855520248413086 nb_pixel_total : 40500 time to create 1 rle with old method : 0.04808449745178223 time for calcul the mask position with numpy : 0.023296356201171875 nb_pixel_total : 46456 time to create 1 rle with old method : 0.05327630043029785 time for calcul the mask position with numpy : 0.02259087562561035 nb_pixel_total : 50821 time to create 1 rle with old method : 0.05675387382507324 time for calcul the mask position with numpy : 0.022094011306762695 nb_pixel_total : 13250 time to create 1 rle with old method : 0.016901731491088867 time for calcul the mask position with numpy : 0.024138689041137695 nb_pixel_total : 36966 time to create 1 rle with old method : 0.04198789596557617 time for calcul the mask position with numpy : 0.021867990493774414 nb_pixel_total : 47476 time to create 1 rle with old method : 0.053429365158081055 time for calcul the mask position with numpy : 0.022710323333740234 nb_pixel_total : 52161 time to create 1 rle with old method : 0.05875205993652344 time for calcul the mask position with numpy : 0.024588346481323242 nb_pixel_total : 23495 time to create 1 rle with old method : 0.02713751792907715 time for calcul the mask position with numpy : 0.02265024185180664 nb_pixel_total : 20643 time to create 1 rle with old method : 0.02337193489074707 time for calcul the mask position with numpy : 0.022013187408447266 nb_pixel_total : 15345 time to create 1 rle with old method : 0.01765751838684082 time for calcul the mask position with numpy : 0.023249149322509766 nb_pixel_total : 19121 time to create 1 rle with old method : 0.021867752075195312 create new chi : 2.5441222190856934 time to delete rle : 0.0015692710876464844 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 9248 TO DO : save crop sub photo not yet done ! save time : 0.60036301612854 nb_obj : 21 nb_hashtags : 3 time to prepare the origin masks : 9.23553729057312 time for calcul the mask position with numpy : 0.5963666439056396 nb_pixel_total : 6217293 time to create 1 rle with new method : 0.6694576740264893 time for calcul the mask position with numpy : 0.021033048629760742 nb_pixel_total : 10005 time to create 1 rle with old method : 0.01143193244934082 time for calcul the mask position with numpy : 0.021344900131225586 nb_pixel_total : 8146 time to create 1 rle with old method : 0.00894618034362793 time for calcul the mask position with numpy : 0.023371458053588867 nb_pixel_total : 11933 time to create 1 rle with old method : 0.013195991516113281 time for calcul the mask position with numpy : 0.022133827209472656 nb_pixel_total : 13091 time to create 1 rle with old method : 0.014353036880493164 time for calcul the mask position with numpy : 0.021620988845825195 nb_pixel_total : 225390 time to create 1 rle with new method : 0.7278764247894287 time for calcul the mask position with numpy : 0.023354053497314453 nb_pixel_total : 1777 time to create 1 rle with old method : 0.002960681915283203 time for calcul the mask position with numpy : 0.024320602416992188 nb_pixel_total : 110945 time to create 1 rle with old method : 0.1276082992553711 time for calcul the mask position with numpy : 0.02246689796447754 nb_pixel_total : 24392 time to create 1 rle with old method : 0.027099609375 time for calcul the mask position with numpy : 0.021986961364746094 nb_pixel_total : 12532 time to create 1 rle with old method : 0.013925552368164062 time for calcul the mask position with numpy : 0.023822307586669922 nb_pixel_total : 14530 time to create 1 rle with old method : 0.01656627655029297 time for calcul the mask position with numpy : 0.022006511688232422 nb_pixel_total : 7268 time to create 1 rle with old method : 0.00823068618774414 time for calcul the mask position with numpy : 0.02354598045349121 nb_pixel_total : 76077 time to create 1 rle with old method : 0.08535647392272949 time for calcul the mask position with numpy : 0.021436691284179688 nb_pixel_total : 11636 time to create 1 rle with old method : 0.013042211532592773 time for calcul the mask position with numpy : 0.021004915237426758 nb_pixel_total : 16554 time to create 1 rle with old method : 0.018158912658691406 time for calcul the mask position with numpy : 0.0214998722076416 nb_pixel_total : 14820 time to create 1 rle with old method : 0.016687393188476562 time for calcul the mask position with numpy : 0.02176523208618164 nb_pixel_total : 70254 time to create 1 rle with old method : 0.07839512825012207 time for calcul the mask position with numpy : 0.020962238311767578 nb_pixel_total : 45129 time to create 1 rle with old method : 0.04932284355163574 time for calcul the mask position with numpy : 0.021796464920043945 nb_pixel_total : 79362 time to create 1 rle with old method : 0.08617520332336426 time for calcul the mask position with numpy : 0.02268218994140625 nb_pixel_total : 15923 time to create 1 rle with old method : 0.01752018928527832 time for calcul the mask position with numpy : 0.023328542709350586 nb_pixel_total : 49102 time to create 1 rle with old method : 0.05507206916809082 time for calcul the mask position with numpy : 0.021759033203125 nb_pixel_total : 14081 time to create 1 rle with old method : 0.015444755554199219 create new chi : 3.2071502208709717 time to delete rle : 0.001748800277709961 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 12410 TO DO : save crop sub photo not yet done ! save time : 0.7407691478729248 nb_obj : 13 nb_hashtags : 2 time to prepare the origin masks : 5.802598476409912 time for calcul the mask position with numpy : 0.5122470855712891 nb_pixel_total : 6281739 time to create 1 rle with new method : 0.9010930061340332 time for calcul the mask position with numpy : 0.026625633239746094 nb_pixel_total : 4054 time to create 1 rle with old method : 0.005414247512817383 time for calcul the mask position with numpy : 0.03655886650085449 nb_pixel_total : 411 time to create 1 rle with old method : 0.0005664825439453125 time for calcul the mask position with numpy : 0.035721540451049805 nb_pixel_total : 249318 time to create 1 rle with new method : 0.8470852375030518 time for calcul the mask position with numpy : 0.03663778305053711 nb_pixel_total : 12295 time to create 1 rle with old method : 0.013859272003173828 time for calcul the mask position with numpy : 0.03288102149963379 nb_pixel_total : 11878 time to create 1 rle with old method : 0.013105392456054688 time for calcul the mask position with numpy : 0.034018754959106445 nb_pixel_total : 189486 time to create 1 rle with new method : 0.7206878662109375 time for calcul the mask position with numpy : 0.029293537139892578 nb_pixel_total : 65035 time to create 1 rle with old method : 0.0706944465637207 time for calcul the mask position with numpy : 0.026286840438842773 nb_pixel_total : 126320 time to create 1 rle with old method : 0.1341385841369629 time for calcul the mask position with numpy : 0.020661592483520508 nb_pixel_total : 18261 time to create 1 rle with old method : 0.019635438919067383 time for calcul the mask position with numpy : 0.020049095153808594 nb_pixel_total : 15765 time to create 1 rle with old method : 0.01666736602783203 time for calcul the mask position with numpy : 0.019176483154296875 nb_pixel_total : 59370 time to create 1 rle with old method : 0.06104850769042969 time for calcul the mask position with numpy : 0.020342111587524414 nb_pixel_total : 7512 time to create 1 rle with old method : 0.008238792419433594 time for calcul the mask position with numpy : 0.020295381546020508 nb_pixel_total : 8796 time to create 1 rle with old method : 0.009372472763061523 create new chi : 3.777794122695923 time to delete rle : 0.0014595985412597656 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 9607 TO DO : save crop sub photo not yet done ! save time : 0.6132228374481201 map_output_result : {1357038184: (0.0, 'Should be the crop_list due to order', 0), 1357038181: (0.0, 'Should be the crop_list due to order', 0), 1357038144: (0.0, 'Should be the crop_list due to order', 0), 1357017288: (0.0, 'Should be the crop_list due to order', 0), 1357017286: (0.0, 'Should be the crop_list due to order', 0), 1357017279: (0.0, 'Should be the crop_list due to order', 0), 1357017276: (0.0, 'Should be the crop_list due to order', 0), 1357017269: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1357038184, 1357038181, 1357038144, 1357017288, 1357017286, 1357017279, 1357017276, 1357017269] Looping around the photos to save general results len do output : 8 /1357038184.Didn't retrieve data . /1357038181.Didn't retrieve data . /1357038144.Didn't retrieve data . /1357017288.Didn't retrieve data . /1357017286.Didn't retrieve data . /1357017279.Didn't retrieve data . /1357017276.Didn't retrieve data . /1357017269.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357038184', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357038181', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357038144', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017288', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017286', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017279', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017276', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017269', None, None, None, None, None, '2808944') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012630939483642578 save_final save missing photos in datou_result : time spend for datou_step_exec : 82.96311092376709 time spend to save output : 0.01297616958618164 total time spend for step 3 : 82.97608709335327 step4:ventilate_hashtags_in_portfolio Thu May 8 22:14:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22803397 get user id for portfolio 22803397 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22803397 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','carton','metal','pehd','papier','flou','background','autre','environnement','pet_fonce','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22803397 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','carton','metal','pehd','papier','flou','background','autre','environnement','pet_fonce','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22803397 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','carton','metal','pehd','papier','flou','background','autre','environnement','pet_fonce','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22804873,22804874,22804875,22804876,22804877,22804878,22804879,22804880,22804881,22804882,22804883?tags=mal_croppe,carton,metal,pehd,papier,flou,background,autre,environnement,pet_fonce,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1357038184, 1357038181, 1357038144, 1357017288, 1357017286, 1357017279, 1357017276, 1357017269] Looping around the photos to save general results len do output : 1 /22803397. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357038184', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357038181', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357038144', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017288', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017286', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017279', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017276', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017269', None, None, None, None, None, '2808944') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01401972770690918 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.551609754562378 time spend to save output : 0.01430201530456543 total time spend for step 4 : 1.5659117698669434 step5:final Thu May 8 22:14:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1357038184: ('0.15098106589279225',), 1357038181: ('0.15098106589279225',), 1357038144: ('0.15098106589279225',), 1357017288: ('0.15098106589279225',), 1357017286: ('0.15098106589279225',), 1357017279: ('0.15098106589279225',), 1357017276: ('0.15098106589279225',), 1357017269: ('0.15098106589279225',)} new output for save of step final : {1357038184: ('0.15098106589279225',), 1357038181: ('0.15098106589279225',), 1357038144: ('0.15098106589279225',), 1357017288: ('0.15098106589279225',), 1357017286: ('0.15098106589279225',), 1357017279: ('0.15098106589279225',), 1357017276: ('0.15098106589279225',), 1357017269: ('0.15098106589279225',)} [1357038184, 1357038181, 1357038144, 1357017288, 1357017286, 1357017279, 1357017276, 1357017269] Looping around the photos to save general results len do output : 8 /1357038184.Didn't retrieve data . /1357038181.Didn't retrieve data . /1357038144.Didn't retrieve data . /1357017288.Didn't retrieve data . /1357017286.Didn't retrieve data . /1357017279.Didn't retrieve data . /1357017276.Didn't retrieve data . /1357017269.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357038184', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357038181', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357038144', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017288', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017286', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017279', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017276', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017269', None, None, None, None, None, '2808944') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012301921844482422 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10767912864685059 time spend to save output : 0.012865304946899414 total time spend for step 5 : 0.12054443359375 step6:blur_detection Thu May 8 22:14:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09.jpg resize: (2160, 3264) 1357038184 0.16322180309753181 treat image : temp/1746735029_2203966_1357038181_0c72c29ee8b542bcbf7df661a97c4e6d.jpg resize: (2160, 3264) 1357038181 0.9652832955289454 treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f.jpg resize: (2160, 3264) 1357038144 -1.323165130152388 treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971.jpg resize: (2160, 3264) 1357017288 -1.0194045349572658 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd.jpg resize: (2160, 3264) 1357017286 0.5940310777286274 treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522.jpg resize: (2160, 3264) 1357017279 -1.8791521657502772 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af.jpg resize: (2160, 3264) 1357017276 -2.164352359900869 treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855.jpg resize: (2160, 3264) 1357017269 -0.5237052308515846 treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569521_0.png resize: (244, 235) 1357060542 -0.7481837285876964 treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569522_0.png resize: (574, 1278) 1357060543 -1.5122534533636867 treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569523_0.png resize: (418, 1367) 1357060545 -0.9931009794037392 treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569524_0.png resize: (190, 147) 1357060546 0.8670779597262955 treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569528_0.png resize: (1417, 2367) 1357060547 -0.23055947386785186 treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569529_0.png resize: (145, 78) 1357060548 -1.1606181506818831 treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569531_0.png resize: (402, 217) 1357060550 -1.932607141069735 treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569533_0.png resize: (185, 196) 1357060551 0.0482466921602095 treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569534_0.png resize: (133, 191) 1357060552 -1.4759738153200004 treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569536_0.png resize: (182, 167) 1357060554 -0.6514092193201451 treat image : temp/1746735029_2203966_1357038181_0c72c29ee8b542bcbf7df661a97c4e6d_rle_crop_3790569539_0.png resize: (374, 328) 1357060555 -2.1664111709975744 treat image : temp/1746735029_2203966_1357038181_0c72c29ee8b542bcbf7df661a97c4e6d_rle_crop_3790569540_0.png resize: (173, 151) 1357060556 -0.7205516185306349 treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569545_0.png resize: (145, 119) 1357060557 -1.3168701862890702 treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569546_0.png resize: (500, 267) 1357060559 -1.4835471196774175 treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569547_0.png resize: (170, 141) 1357060560 -1.431830967267585 treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569548_0.png resize: (191, 204) 1357060561 -1.5136270832889205 treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569549_0.png resize: (56, 81) 1357060563 20.0 treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569551_0.png resize: (124, 231) 1357060565 -1.0340385319729164 treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569552_0.png resize: (121, 132) 1357060566 -2.1548785328080866 treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569553_0.png resize: (102, 137) 1357060567 -0.4356313433881437 treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569555_0.png resize: (277, 225) 1357060569 -2.520316189495146 treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569556_0.png resize: (109, 113) 1357060570 -1.543819068487199 treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569557_0.png resize: (152, 97) 1357060571 -1.4627112899646388 treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569560_0.png resize: (224, 219) 1357060573 -0.6916175387083626 treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569561_0.png resize: (181, 182) 1357060574 -1.3276466374470328 treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569562_0.png resize: (384, 376) 1357060575 -0.3260008719717341 treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569563_0.png resize: (107, 155) 1357060576 -1.4749056441909396 treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569565_0.png resize: (127, 119) 1357060578 0.47840186393737494 treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569566_0.png resize: (70, 59) 1357060579 20.0 treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569567_0.png resize: (176, 171) 1357060580 -1.0720502247486958 treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569568_0.png resize: (134, 101) 1357060582 -0.023883281591210066 treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569570_0.png resize: (503, 286) 1357060583 -1.9069440681662109 treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569572_0.png resize: (389, 245) 1357060584 -0.5101392468516831 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569573_0.png resize: (917, 781) 1357060585 -1.1593106267956879 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569574_0.png resize: (252, 105) 1357060587 -1.9046274109592813 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569575_0.png resize: (203, 241) 1357060588 -1.9351573930205188 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569576_0.png resize: (169, 176) 1357060589 -1.005981246988902 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569577_0.png resize: (469, 331) 1357060591 -0.8456468184746814 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569578_0.png resize: (189, 137) 1357060592 -1.5052288622579877 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569579_0.png resize: (91, 185) 1357060593 0.2441162760655024 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569580_0.png resize: (264, 305) 1357060595 -1.2667961914859094 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569582_0.png resize: (305, 117) 1357060596 -1.3722068025212912 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569583_0.png resize: (209, 171) 1357060598 -0.15339357731773376 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569584_0.png resize: (300, 340) 1357060599 -0.9843366271107334 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569585_0.png resize: (129, 116) 1357060601 -0.4940101729289549 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569587_0.png resize: (360, 294) 1357060602 -0.34870999896012705 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569588_0.png resize: (286, 159) 1357060603 -1.0543899594761315 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569589_0.png resize: (327, 409) 1357060605 -1.3260934240517679 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569591_0.png resize: (163, 182) 1357060606 -0.7071797493184919 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569592_0.png resize: (155, 88) 1357060607 -2.341685975623835 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569593_0.png resize: (652, 547) 1357060608 -1.0517996681617479 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569594_0.png resize: (400, 187) 1357060610 -2.0665367334529563 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569595_0.png resize: (115, 157) 1357060611 0.3503034719643273 treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569597_0.png resize: (154, 184) 1357060612 -0.5461289442538318 treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569598_0.png resize: (175, 227) 1357060614 -1.2537715548521724 treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569599_0.png resize: (200, 162) 1357060615 -1.4142887932774442 treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569600_0.png resize: (419, 262) 1357060616 -1.7505208084511135 treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569603_0.png resize: (120, 141) 1357060618 0.243267555448703 treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569606_0.png resize: (325, 191) 1357060619 -0.3355686908661817 treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569607_0.png resize: (195, 111) 1357060620 -1.6884599467610084 treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569609_0.png resize: (115, 124) 1357060621 -1.5949301170798054 treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569610_0.png resize: (199, 189) 1357060624 -0.8638187191400374 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569611_0.png resize: (184, 112) 1357060625 -1.5297062234154783 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569612_0.png resize: (232, 265) 1357060626 -1.2134156737015391 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569613_0.png resize: (168, 137) 1357060628 -1.1551369729828986 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569614_0.png resize: (340, 334) 1357060629 -1.7238029188224568 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569617_0.png resize: (160, 177) 1357060630 -1.3796602819935326 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569618_0.png resize: (194, 147) 1357060631 -2.0472412911393763 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569620_0.png resize: (400, 358) 1357060633 -1.3425819667274705 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569621_0.png resize: (91, 126) 1357060634 1.5609201201723704 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569622_0.png resize: (150, 155) 1357060635 -2.5460219935045343 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569623_0.png resize: (101, 159) 1357060637 -0.31931462234786284 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569624_0.png resize: (161, 203) 1357060638 -1.2020019818491152 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569626_0.png resize: (54, 45) 1357060639 -0.5683873127534376 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569627_0.png resize: (900, 422) 1357060641 -1.0374341767293065 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569628_0.png resize: (242, 108) 1357060643 -2.1652418907249276 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569629_0.png resize: (133, 118) 1357060644 -1.1252917395289208 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569631_0.png resize: (127, 101) 1357060645 1.5822714751414622 treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569632_0.png resize: (197, 93) 1357060647 -1.6248188967006747 treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569633_0.png resize: (123, 84) 1357060648 -1.1563015418927884 treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569634_0.png resize: (231, 397) 1357060649 -2.3738275228195183 treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569635_0.png resize: (116, 147) 1357060650 2.5391005485922244 treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569636_0.png resize: (151, 155) 1357060652 -0.7645707876012983 treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569637_0.png resize: (508, 646) 1357060653 -1.8661704917808621 treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569639_0.png resize: (520, 618) 1357060654 -1.3159805324984608 treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569640_0.png resize: (142, 124) 1357060656 -0.2287197700708165 treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569641_0.png resize: (241, 127) 1357060657 -2.1813288547268264 treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569642_0.png resize: (762, 458) 1357060658 -1.3143333420136416 treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569643_0.png resize: (104, 225) 1357060659 -1.1487270278372839 treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569644_0.png resize: (183, 179) 1357060661 -0.8075208410171342 treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569525_0.png resize: (596, 388) 1357060744 -1.2320808166060297 treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569527_0.png resize: (203, 224) 1357060745 -1.5618466964810076 treat image : temp/1746735029_2203966_1357038181_0c72c29ee8b542bcbf7df661a97c4e6d_rle_crop_3790569538_0.png resize: (531, 264) 1357060748 -1.0166203852179914 treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569544_0.png resize: (124, 127) 1357060749 2.602620125555753 treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569550_0.png resize: (163, 163) 1357060750 -2.422408329180729 treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569554_0.png resize: (150, 177) 1357060752 -0.5925313514247272 treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569558_0.png resize: (187, 175) 1357060754 -1.2356902553533335 treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569569_0.png resize: (113, 146) 1357060755 -0.6573230032314721 treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569571_0.png resize: (186, 150) 1357060756 0.32276538139221683 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569581_0.png resize: (200, 224) 1357060759 -2.283408176846283 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569590_0.png resize: (670, 715) 1357060760 -0.566918264792757 treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569604_0.png resize: (265, 238) 1357060761 -1.563348221286754 treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569608_0.png resize: (135, 146) 1357060763 -1.7226143386896078 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569630_0.png resize: (180, 70) 1357060765 -1.9987024503508075 treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569526_0.png resize: (407, 163) 1357060824 -1.2270818148189655 treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569530_0.png resize: (237, 476) 1357060825 -1.616329972764521 treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569532_0.png resize: (304, 485) 1357060826 -0.9896441005021519 treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569535_0.png resize: (228, 465) 1357060827 -0.9155538180812823 treat image : temp/1746735029_2203966_1357038181_0c72c29ee8b542bcbf7df661a97c4e6d_rle_crop_3790569541_0.png resize: (548, 372) 1357060828 -1.6944280628709545 treat image : temp/1746735029_2203966_1357038181_0c72c29ee8b542bcbf7df661a97c4e6d_rle_crop_3790569542_0.png resize: (683, 591) 1357060829 -1.0564782863733382 treat image : temp/1746735029_2203966_1357038181_0c72c29ee8b542bcbf7df661a97c4e6d_rle_crop_3790569543_0.png resize: (738, 408) 1357060830 -0.8018163902569742 treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569559_0.png resize: (500, 376) 1357060831 -1.0072067083010046 treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569564_0.png resize: (318, 242) 1357060832 -1.2591614517349938 treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569586_0.png resize: (276, 689) 1357060833 -1.3479120603171568 treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569596_0.png resize: (170, 149) 1357060834 -3.3041519188214057 treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569602_0.png resize: (193, 213) 1357060835 -1.2678791117146722 treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569605_0.png resize: (345, 174) 1357060836 -2.4247025966988818 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569615_0.png resize: (329, 171) 1357060837 -2.368716456380764 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569616_0.png resize: (272, 402) 1357060838 -2.6697242209167533 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569619_0.png resize: (132, 109) 1357060839 -3.7085488317891486 treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569625_0.png resize: (423, 370) 1357060840 -1.6942952513188039 treat image : temp/1746735029_2203966_1357038181_0c72c29ee8b542bcbf7df661a97c4e6d_rle_crop_3790569537_0.png resize: (357, 354) 1357060844 2.1354116205110594 treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569601_0.png resize: (223, 375) 1357060858 -2.082945352938253 treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569638_0.png resize: (215, 415) 1357060859 -1.0851105776006715 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 132 time used for this insertion : 0.018412351608276367 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 132 time used for this insertion : 0.029915571212768555 save missing photos in datou_result : time spend for datou_step_exec : 30.727107286453247 time spend to save output : 0.053960323333740234 total time spend for step 6 : 30.781067609786987 step7:brightness Thu May 8 22:15:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09.jpg treat image : temp/1746735029_2203966_1357038181_0c72c29ee8b542bcbf7df661a97c4e6d.jpg treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f.jpg treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971.jpg treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd.jpg treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522.jpg treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af.jpg treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855.jpg treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569521_0.png treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569522_0.png treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569523_0.png treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569524_0.png treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569528_0.png treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569529_0.png treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569531_0.png treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569533_0.png treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569534_0.png treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569536_0.png treat image : temp/1746735029_2203966_1357038181_0c72c29ee8b542bcbf7df661a97c4e6d_rle_crop_3790569539_0.png treat image : temp/1746735029_2203966_1357038181_0c72c29ee8b542bcbf7df661a97c4e6d_rle_crop_3790569540_0.png treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569545_0.png treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569546_0.png treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569547_0.png treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569548_0.png treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569549_0.png treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569551_0.png treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569552_0.png treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569553_0.png treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569555_0.png treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569556_0.png treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569557_0.png treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569560_0.png treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569561_0.png treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569562_0.png treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569563_0.png treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569565_0.png treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569566_0.png treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569567_0.png treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569568_0.png treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569570_0.png treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569572_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569573_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569574_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569575_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569576_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569577_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569578_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569579_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569580_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569582_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569583_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569584_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569585_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569587_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569588_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569589_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569591_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569592_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569593_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569594_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569595_0.png treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569597_0.png treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569598_0.png treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569599_0.png treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569600_0.png treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569603_0.png treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569606_0.png treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569607_0.png treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569609_0.png treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569610_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569611_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569612_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569613_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569614_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569617_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569618_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569620_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569621_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569622_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569623_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569624_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569626_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569627_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569628_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569629_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569631_0.png treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569632_0.png treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569633_0.png treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569634_0.png treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569635_0.png treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569636_0.png treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569637_0.png treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569639_0.png treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569640_0.png treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569641_0.png treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569642_0.png treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569643_0.png treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569644_0.png treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569525_0.png treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569527_0.png treat image : temp/1746735029_2203966_1357038181_0c72c29ee8b542bcbf7df661a97c4e6d_rle_crop_3790569538_0.png treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569544_0.png treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569550_0.png treat image : temp/1746735029_2203966_1357038144_c21f632c7b3c736bcb88539701efd10f_rle_crop_3790569554_0.png treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569558_0.png treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569569_0.png treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569571_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569581_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569590_0.png treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569604_0.png treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569608_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569630_0.png treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569526_0.png treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569530_0.png treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569532_0.png treat image : temp/1746735029_2203966_1357038184_c7cddeb71d392efe0237262ade3b2e09_rle_crop_3790569535_0.png treat image : temp/1746735029_2203966_1357038181_0c72c29ee8b542bcbf7df661a97c4e6d_rle_crop_3790569541_0.png treat image : temp/1746735029_2203966_1357038181_0c72c29ee8b542bcbf7df661a97c4e6d_rle_crop_3790569542_0.png treat image : temp/1746735029_2203966_1357038181_0c72c29ee8b542bcbf7df661a97c4e6d_rle_crop_3790569543_0.png treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569559_0.png treat image : temp/1746735029_2203966_1357017288_0f82edf5ad80c1a5951751e22c2ef971_rle_crop_3790569564_0.png treat image : temp/1746735029_2203966_1357017286_c2be8fd7506665d3aba2309cfe01a2fd_rle_crop_3790569586_0.png treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569596_0.png treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569602_0.png treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569605_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569615_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569616_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569619_0.png treat image : temp/1746735029_2203966_1357017276_6dfbcf4733719fa4b067fcdd455af3af_rle_crop_3790569625_0.png treat image : temp/1746735029_2203966_1357038181_0c72c29ee8b542bcbf7df661a97c4e6d_rle_crop_3790569537_0.png treat image : temp/1746735029_2203966_1357017279_9f3969c3e453c2e240658e5faf2bf522_rle_crop_3790569601_0.png treat image : temp/1746735029_2203966_1357017269_d804c7d8b4ab4c1a8666246ef8c58855_rle_crop_3790569638_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 132 time used for this insertion : 0.01802825927734375 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 132 time used for this insertion : 0.028247356414794922 save missing photos in datou_result : time spend for datou_step_exec : 8.285847902297974 time spend to save output : 0.05125236511230469 total time spend for step 7 : 8.337100267410278 step8:velours_tree Thu May 8 22:15:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09511637687683105 time spend to save output : 4.291534423828125e-05 total time spend for step 8 : 0.09515929222106934 step9:send_mail_cod Thu May 8 22:15:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22803397_08-05-2025_22_15_13.pdf 22804873 imagette228048731746735313 22804874 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette228048741746735313 22804875 imagette228048751746735313 22804876 imagette228048761746735313 22804877 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette228048771746735313 22804878 imagette228048781746735315 22804879 imagette228048791746735315 22804880 change filename to text .imagette228048801746735315 22804882 change filename to text .change filename to text .imagette228048821746735315 22804883 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette228048831746735315 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22803397 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22804873,22804874,22804875,22804876,22804877,22804878,22804879,22804880,22804881,22804882,22804883?tags=mal_croppe,carton,metal,pehd,papier,flou,background,autre,environnement,pet_fonce,pet_clair args[1357038184] : ((1357038184, 0.16322180309753181, 492688767), (1357038184, -0.012153550923386994, 2107752395), '0.15098106589279225') We are sending mail with results at report@fotonower.com args[1357038181] : ((1357038181, 0.9652832955289454, 492688767), (1357038181, -0.1717036241556262, 496442774), '0.15098106589279225') We are sending mail with results at report@fotonower.com args[1357038144] : ((1357038144, -1.323165130152388, 492688767), (1357038144, -0.0006242185235895838, 2107752395), '0.15098106589279225') We are sending mail with results at report@fotonower.com args[1357017288] : ((1357017288, -1.0194045349572658, 492688767), (1357017288, 0.00026074600914935983, 2107752395), '0.15098106589279225') We are sending mail with results at report@fotonower.com args[1357017286] : ((1357017286, 0.5940310777286274, 492688767), (1357017286, -0.14237202388668632, 496442774), '0.15098106589279225') We are sending mail with results at report@fotonower.com args[1357017279] : ((1357017279, -1.8791521657502772, 492688767), (1357017279, -0.1546846439193095, 496442774), '0.15098106589279225') We are sending mail with results at report@fotonower.com args[1357017276] : ((1357017276, -2.164352359900869, 492609224), (1357017276, 0.11761356625186775, 2107752395), '0.15098106589279225') We are sending mail with results at report@fotonower.com args[1357017269] : ((1357017269, -0.5237052308515846, 492688767), (1357017269, -0.10913315859876566, 496442774), '0.15098106589279225') We are sending mail with results at report@fotonower.com refus_total : 0.15098106589279225 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22803397 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22803397_08-05-2025_22_15_13.pdf results_Auto_P22803397_08-05-2025_22_15_13.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22803397_08-05-2025_22_15_13.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22803397','results_Auto_P22803397_08-05-2025_22_15_13.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22803397_08-05-2025_22_15_13.pdf','pdf','','0.58','0.15098106589279225') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22803397

https://www.fotonower.com/image?json=false&list_photos_id=1357038184
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357038181
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357038144
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357017288
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357017286
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357017279
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357017276
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357017269
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 15.10%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/22804874?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22804877?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22804880?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/22804882?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22804883?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22803397_08-05-2025_22_15_13.pdf.

Lien vers velours :https://www.fotonower.com/velours/22804873,22804874,22804875,22804876,22804877,22804878,22804879,22804880,22804881,22804882,22804883?tags=mal_croppe,carton,metal,pehd,papier,flou,background,autre,environnement,pet_fonce,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 08 May 2025 20:15:19 GMT Content-Length: 0 Connection: close X-Message-Id: 2dmjpGf0R42FvZmiDmvSNw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1357038184, 1357038181, 1357038144, 1357017288, 1357017286, 1357017279, 1357017276, 1357017269] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357038184', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357038181', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357038144', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017288', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017286', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017279', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017276', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017269', None, None, None, None, None, '2808944') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.013203620910644531 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.988795280456543 time spend to save output : 0.013423442840576172 total time spend for step 9 : 6.002218723297119 step10:split_time_score Thu May 8 22:15:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 08052025 22803397 Nombre de photos uploadées : 8 / 23040 (0%) 08052025 22803397 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 08052025 22803397 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.00043773651123046875 elapsed_time : insert_dashboard_record_day_entry 0.026658296585083008 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.09101863626923734 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22797335_08-05-2025_10_41_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22797335 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22797335 AND mptpi.`type`=3726 To do Qualite : 0.1491809971480875 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22796754_08-05-2025_09_01_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22796754 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22796754 AND mptpi.`type`=3594 To do Qualite : 0.036240760927195435 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22797341_08-05-2025_10_21_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22797341 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22797341 AND mptpi.`type`=3726 To do Qualite : 0.11290551243835029 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22803394_08-05-2025_20_42_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22803394 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22803394 AND mptpi.`type`=3726 To do Qualite : 0.0951294665534718 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22797981_08-05-2025_11_11_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22797981 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22797981 AND mptpi.`type`=3726 To do Qualite : 0.042063713081336246 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22798499_08-05-2025_12_10_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22798499 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22798499 AND mptpi.`type`=3726 To do Qualite : 0.037676790389423696 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22798724_08-05-2025_12_38_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22798724 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22798724 AND mptpi.`type`=3726 To do Qualite : 0.1469477191556599 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22800773_08-05-2025_15_50_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22800773 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22800773 AND mptpi.`type`=3594 To do Qualite : 0.12962935884581103 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22799861_08-05-2025_14_17_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22799861 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22799861 AND mptpi.`type`=3594 To do Qualite : 0.13872483152505186 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22800776_08-05-2025_15_43_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22800776 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22800776 AND mptpi.`type`=3726 To do Qualite : 0.127602651881095 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22800290_08-05-2025_14_42_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22800290 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22800290 AND mptpi.`type`=3726 To do Qualite : 0.11184673670579505 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22800777_08-05-2025_15_43_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22800777 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22800777 AND mptpi.`type`=3726 To do Qualite : 0.13374742483155816 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22801541_08-05-2025_17_34_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22801541 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22801541 AND mptpi.`type`=3594 To do Qualite : 0.15098106589279225 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22803397_08-05-2025_22_15_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22803397 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22803397 AND mptpi.`type`=3594 To do Qualite : 0.15091523125453885 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22802363_08-05-2025_19_24_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22802363 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22802363 AND mptpi.`type`=3594 To do Qualite : 0.038327863590639714 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22802367_08-05-2025_20_14_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22802367 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22802367 AND mptpi.`type`=3726 To do Qualite : 0.1634540721308779 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22803402_08-05-2025_21_01_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22803402 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22803402 AND mptpi.`type`=3594 To do Qualite : 0.12064757563378889 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22803405_08-05-2025_21_52_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22803405 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22803405 AND mptpi.`type`=3594 To do Qualite : 0.13211916514832123 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22803870_08-05-2025_21_43_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22803870 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22803870 AND mptpi.`type`=3726 To do Qualite : 0.11371009859382555 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22803872_08-05-2025_21_31_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22803872 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22803872 AND mptpi.`type`=3726 To do Qualite : 0.09399736386161102 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22803874_08-05-2025_21_12_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22803874 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22803874 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'08052025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1357038184, 1357038181, 1357038144, 1357017288, 1357017286, 1357017279, 1357017276, 1357017269] Looping around the photos to save general results len do output : 1 /22803397Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357038184', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357038181', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357038144', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017288', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017286', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017279', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017276', None, None, None, None, None, '2808944') ('3318', None, None, None, None, None, None, None, '2808944') ('3318', '22803397', '1357017269', None, None, None, None, None, '2808944') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.012804746627807617 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.4296395778656006 time spend to save output : 0.013002872467041016 total time spend for step 10 : 1.4426424503326416 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 125.42user 123.78system 4:54.36elapsed 84%CPU (0avgtext+0avgdata 4671036maxresident)k 21160inputs+80352outputs (624major+10702012minor)pagefaults 0swaps