python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1378438 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3515065'] with mtr_portfolio_ids : ['25922590'] and first list_photo_ids : [] new path : /proc/1378438/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 1.5603182315826416 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Aug 12 17:40:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10957 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-12 17:40:33.107662: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-12 17:40:33.131389: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-08-12 17:40:33.133391: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f2544000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-12 17:40:33.133436: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-12 17:40:33.136842: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-12 17:40:33.305993: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x435318b0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-12 17:40:33.306038: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-12 17:40:33.307347: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-12 17:40:33.311214: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-12 17:40:33.314229: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-12 17:40:33.316643: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-12 17:40:33.316995: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-12 17:40:33.319725: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-12 17:40:33.320920: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-12 17:40:33.325807: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-12 17:40:33.327175: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-12 17:40:33.327230: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-12 17:40:33.327943: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-12 17:40:33.327957: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-12 17:40:33.327965: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-12 17:40:33.329257: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10154 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-12 17:40:33.570074: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-12 17:40:33.570156: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-12 17:40:33.570176: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-12 17:40:33.570195: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-12 17:40:33.570212: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-12 17:40:33.570230: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-12 17:40:33.570248: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-12 17:40:33.570265: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-12 17:40:33.571856: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-12 17:40:33.573162: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-12 17:40:33.573197: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-12 17:40:33.573215: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-12 17:40:33.573232: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-12 17:40:33.573249: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-12 17:40:33.573266: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-12 17:40:33.573283: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-12 17:40:33.573300: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-12 17:40:33.574865: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-12 17:40:33.574895: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-12 17:40:33.574905: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-12 17:40:33.574914: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-12 17:40:33.576548: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10154 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-12 17:40:41.034183: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-12 17:40:41.220444: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 47.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 47.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 63.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 Detection mask done ! Trying to reset tf kernel 1378887 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4866 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5665 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0002281665802001953 nb_pixel_total : 7349 time to create 1 rle with old method : 0.008440732955932617 length of segment : 82 time for calcul the mask position with numpy : 0.00012421607971191406 nb_pixel_total : 4010 time to create 1 rle with old method : 0.005002737045288086 length of segment : 71 time for calcul the mask position with numpy : 0.0019919872283935547 nb_pixel_total : 97696 time to create 1 rle with old method : 0.11012005805969238 length of segment : 529 time for calcul the mask position with numpy : 0.0002422332763671875 nb_pixel_total : 12171 time to create 1 rle with old method : 0.013336181640625 length of segment : 156 time for calcul the mask position with numpy : 0.00036525726318359375 nb_pixel_total : 20428 time to create 1 rle with old method : 0.02243947982788086 length of segment : 183 time for calcul the mask position with numpy : 0.0001575946807861328 nb_pixel_total : 7875 time to create 1 rle with old method : 0.008796930313110352 length of segment : 82 time for calcul the mask position with numpy : 0.001451730728149414 nb_pixel_total : 101880 time to create 1 rle with old method : 0.10889220237731934 length of segment : 505 time for calcul the mask position with numpy : 0.0001685619354248047 nb_pixel_total : 7507 time to create 1 rle with old method : 0.008423805236816406 length of segment : 83 time for calcul the mask position with numpy : 0.0001220703125 nb_pixel_total : 7175 time to create 1 rle with old method : 0.00844573974609375 length of segment : 70 time for calcul the mask position with numpy : 0.00025653839111328125 nb_pixel_total : 15322 time to create 1 rle with old method : 0.017303466796875 length of segment : 164 time for calcul the mask position with numpy : 0.00014853477478027344 nb_pixel_total : 5823 time to create 1 rle with old method : 0.006883859634399414 length of segment : 137 time for calcul the mask position with numpy : 0.00015425682067871094 nb_pixel_total : 8273 time to create 1 rle with old method : 0.009492158889770508 length of segment : 106 time for calcul the mask position with numpy : 0.00027823448181152344 nb_pixel_total : 14862 time to create 1 rle with old method : 0.01652240753173828 length of segment : 170 time for calcul the mask position with numpy : 0.00010180473327636719 nb_pixel_total : 4114 time to create 1 rle with old method : 0.0045697689056396484 length of segment : 144 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 4043 time to create 1 rle with old method : 0.0046384334564208984 length of segment : 141 time for calcul the mask position with numpy : 0.00035309791564941406 nb_pixel_total : 20969 time to create 1 rle with old method : 0.022947311401367188 length of segment : 208 time for calcul the mask position with numpy : 0.00019931793212890625 nb_pixel_total : 12346 time to create 1 rle with old method : 0.014017820358276367 length of segment : 98 time for calcul the mask position with numpy : 0.0003418922424316406 nb_pixel_total : 18364 time to create 1 rle with old method : 0.02102804183959961 length of segment : 116 time for calcul the mask position with numpy : 0.00012373924255371094 nb_pixel_total : 4295 time to create 1 rle with old method : 0.0049402713775634766 length of segment : 77 time for calcul the mask position with numpy : 0.0002574920654296875 nb_pixel_total : 12968 time to create 1 rle with old method : 0.01443624496459961 length of segment : 145 time for calcul the mask position with numpy : 0.00010085105895996094 nb_pixel_total : 2950 time to create 1 rle with old method : 0.0032677650451660156 length of segment : 60 time for calcul the mask position with numpy : 0.0001742839813232422 nb_pixel_total : 12721 time to create 1 rle with old method : 0.014371871948242188 length of segment : 100 time for calcul the mask position with numpy : 0.0002448558807373047 nb_pixel_total : 16382 time to create 1 rle with old method : 0.01869368553161621 length of segment : 144 time for calcul the mask position with numpy : 0.0004057884216308594 nb_pixel_total : 26127 time to create 1 rle with old method : 0.02825760841369629 length of segment : 173 time for calcul the mask position with numpy : 0.0003170967102050781 nb_pixel_total : 22682 time to create 1 rle with old method : 0.025595903396606445 length of segment : 180 time for calcul the mask position with numpy : 0.00022649765014648438 nb_pixel_total : 14143 time to create 1 rle with old method : 0.015322446823120117 length of segment : 182 time for calcul the mask position with numpy : 9.274482727050781e-05 nb_pixel_total : 4192 time to create 1 rle with old method : 0.004838466644287109 length of segment : 79 time for calcul the mask position with numpy : 0.00016069412231445312 nb_pixel_total : 9579 time to create 1 rle with old method : 0.010736942291259766 length of segment : 156 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 3409 time to create 1 rle with old method : 0.00396728515625 length of segment : 70 time for calcul the mask position with numpy : 0.0001881122589111328 nb_pixel_total : 8185 time to create 1 rle with old method : 0.0113525390625 length of segment : 75 time for calcul the mask position with numpy : 0.00020241737365722656 nb_pixel_total : 11871 time to create 1 rle with old method : 0.013103246688842773 length of segment : 110 time for calcul the mask position with numpy : 0.00015997886657714844 nb_pixel_total : 8836 time to create 1 rle with old method : 0.010365486145019531 length of segment : 98 time for calcul the mask position with numpy : 0.0001220703125 nb_pixel_total : 7492 time to create 1 rle with old method : 0.008205413818359375 length of segment : 116 time for calcul the mask position with numpy : 0.00012731552124023438 nb_pixel_total : 6070 time to create 1 rle with old method : 0.007061958312988281 length of segment : 69 time for calcul the mask position with numpy : 0.00011134147644042969 nb_pixel_total : 6227 time to create 1 rle with old method : 0.007104635238647461 length of segment : 69 time for calcul the mask position with numpy : 0.0001690387725830078 nb_pixel_total : 8579 time to create 1 rle with old method : 0.0098114013671875 length of segment : 128 time for calcul the mask position with numpy : 0.0016338825225830078 nb_pixel_total : 81293 time to create 1 rle with old method : 0.08780384063720703 length of segment : 477 time for calcul the mask position with numpy : 0.00035858154296875 nb_pixel_total : 13185 time to create 1 rle with old method : 0.014568805694580078 length of segment : 224 time for calcul the mask position with numpy : 8.535385131835938e-05 nb_pixel_total : 3615 time to create 1 rle with old method : 0.004008293151855469 length of segment : 68 time for calcul the mask position with numpy : 0.00015044212341308594 nb_pixel_total : 4929 time to create 1 rle with old method : 0.0055463314056396484 length of segment : 130 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 3290 time to create 1 rle with old method : 0.0037326812744140625 length of segment : 80 time for calcul the mask position with numpy : 0.0002465248107910156 nb_pixel_total : 19123 time to create 1 rle with old method : 0.020668506622314453 length of segment : 120 time for calcul the mask position with numpy : 0.0002486705780029297 nb_pixel_total : 7091 time to create 1 rle with old method : 0.007870197296142578 length of segment : 107 time for calcul the mask position with numpy : 0.00036144256591796875 nb_pixel_total : 20223 time to create 1 rle with old method : 0.022037029266357422 length of segment : 114 time for calcul the mask position with numpy : 0.0005099773406982422 nb_pixel_total : 20475 time to create 1 rle with old method : 0.021852493286132812 length of segment : 223 time for calcul the mask position with numpy : 0.0003311634063720703 nb_pixel_total : 8468 time to create 1 rle with old method : 0.009138822555541992 length of segment : 171 time for calcul the mask position with numpy : 0.006707906723022461 nb_pixel_total : 336428 time to create 1 rle with new method : 0.14101696014404297 length of segment : 778 time spent for convertir_results : 2.2240309715270996 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 47 chid ids of type : 3594 Number RLEs to save : 7568 save missing photos in datou_result : time spend for datou_step_exec : 23.360796213150024 time spend to save output : 0.4760904312133789 total time spend for step 1 : 23.836886644363403 step2:crop_condition Tue Aug 12 17:40:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 47 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 27 About to insert : list_path_to_insert length 27 new photo from crops ! About to upload 27 photos upload in portfolio : 3736932 init cache_photo without model_param we have 27 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755013256_1378438 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 27 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.348522901535034 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755013263_1378438 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.1152591705322266 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755013265_1378438 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.504819393157959 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3736932 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755013269_1378438 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 8 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.648744821548462 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755013274_1378438 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8448762893676758 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1376643665, 1376643320, 1376643261, 1376643201, 1376643135, 1376643078, 1376643015, 1376642638, 1376642602, 1376642560] Looping around the photos to save general results len do output : 47 /1376652073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1376652124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643665', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643320', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643261', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643201', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643135', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643078', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643015', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376642638', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376642602', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376642560', None, None, None, None, None, '3515065') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 151 time used for this insertion : 0.021021127700805664 save_final save missing photos in datou_result : time spend for datou_step_exec : 20.238879680633545 time spend to save output : 0.023068666458129883 total time spend for step 2 : 20.261948347091675 step3:rle_unique_nms_with_priority Tue Aug 12 17:41:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 47 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.3175506591796875 time for calcul the mask position with numpy : 0.20845508575439453 nb_pixel_total : 1964545 time to create 1 rle with new method : 0.11469268798828125 time for calcul the mask position with numpy : 0.0064945220947265625 nb_pixel_total : 97696 time to create 1 rle with old method : 0.10354113578796387 time for calcul the mask position with numpy : 0.0059778690338134766 nb_pixel_total : 4010 time to create 1 rle with old method : 0.0043773651123046875 time for calcul the mask position with numpy : 0.005906105041503906 nb_pixel_total : 7349 time to create 1 rle with old method : 0.007756233215332031 create new chi : 0.46782636642456055 time to delete rle : 0.02156376838684082 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2444 TO DO : save crop sub photo not yet done ! save time : 0.17583703994750977 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.1267082691192627 time for calcul the mask position with numpy : 0.11785459518432617 nb_pixel_total : 2041001 time to create 1 rle with new method : 0.09148192405700684 time for calcul the mask position with numpy : 0.005995512008666992 nb_pixel_total : 20428 time to create 1 rle with old method : 0.02332282066345215 time for calcul the mask position with numpy : 0.005918264389038086 nb_pixel_total : 12171 time to create 1 rle with old method : 0.012913703918457031 create new chi : 0.26453161239624023 time to delete rle : 0.0002586841583251953 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 1758 TO DO : save crop sub photo not yet done ! save time : 0.12982821464538574 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 0.38718128204345703 time for calcul the mask position with numpy : 0.13863229751586914 nb_pixel_total : 1919745 time to create 1 rle with new method : 0.10600590705871582 time for calcul the mask position with numpy : 0.010445833206176758 nb_pixel_total : 8273 time to create 1 rle with old method : 0.008975028991699219 time for calcul the mask position with numpy : 0.005997419357299805 nb_pixel_total : 5823 time to create 1 rle with old method : 0.0062351226806640625 time for calcul the mask position with numpy : 0.00597691535949707 nb_pixel_total : 15322 time to create 1 rle with old method : 0.016222476959228516 time for calcul the mask position with numpy : 0.006013154983520508 nb_pixel_total : 7175 time to create 1 rle with old method : 0.007752895355224609 time for calcul the mask position with numpy : 0.005814075469970703 nb_pixel_total : 7507 time to create 1 rle with old method : 0.007889270782470703 time for calcul the mask position with numpy : 0.006766796112060547 nb_pixel_total : 101880 time to create 1 rle with old method : 0.10788869857788086 time for calcul the mask position with numpy : 0.0062448978424072266 nb_pixel_total : 7875 time to create 1 rle with old method : 0.008502960205078125 create new chi : 0.4659907817840576 time to delete rle : 0.0005209445953369141 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 3374 TO DO : save crop sub photo not yet done ! save time : 0.22926616668701172 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.07912921905517578 time for calcul the mask position with numpy : 0.027303218841552734 nb_pixel_total : 2054596 time to create 1 rle with new method : 0.20836877822875977 time for calcul the mask position with numpy : 0.005692481994628906 nb_pixel_total : 28 time to create 1 rle with old method : 7.510185241699219e-05 time for calcul the mask position with numpy : 0.0056760311126708984 nb_pixel_total : 4114 time to create 1 rle with old method : 0.004361867904663086 time for calcul the mask position with numpy : 0.0057070255279541016 nb_pixel_total : 14862 time to create 1 rle with old method : 0.015623331069946289 create new chi : 0.27310705184936523 time to delete rle : 0.0002713203430175781 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1736 TO DO : save crop sub photo not yet done ! save time : 0.13043808937072754 nb_obj : 5 nb_hashtags : 4 time to prepare the origin masks : 0.060166358947753906 time for calcul the mask position with numpy : 0.018349885940551758 nb_pixel_total : 2004658 time to create 1 rle with new method : 0.09439301490783691 time for calcul the mask position with numpy : 0.005845308303833008 nb_pixel_total : 12968 time to create 1 rle with old method : 0.013455867767333984 time for calcul the mask position with numpy : 0.005655050277709961 nb_pixel_total : 4295 time to create 1 rle with old method : 0.004633665084838867 time for calcul the mask position with numpy : 0.005972146987915039 nb_pixel_total : 18364 time to create 1 rle with old method : 0.01959061622619629 time for calcul the mask position with numpy : 0.005778074264526367 nb_pixel_total : 12346 time to create 1 rle with old method : 0.013101816177368164 time for calcul the mask position with numpy : 0.005824089050292969 nb_pixel_total : 20969 time to create 1 rle with old method : 0.022761821746826172 create new chi : 0.22543597221374512 time to delete rle : 0.0004172325134277344 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2368 TO DO : save crop sub photo not yet done ! save time : 0.1712334156036377 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 0.6059679985046387 time for calcul the mask position with numpy : 0.08851861953735352 nb_pixel_total : 1941359 time to create 1 rle with new method : 0.26386141777038574 time for calcul the mask position with numpy : 0.006155490875244141 nb_pixel_total : 11871 time to create 1 rle with old method : 0.01238560676574707 time for calcul the mask position with numpy : 0.005776166915893555 nb_pixel_total : 8185 time to create 1 rle with old method : 0.008596658706665039 time for calcul the mask position with numpy : 0.005731105804443359 nb_pixel_total : 3409 time to create 1 rle with old method : 0.0035486221313476562 time for calcul the mask position with numpy : 0.005692005157470703 nb_pixel_total : 9579 time to create 1 rle with old method : 0.01048421859741211 time for calcul the mask position with numpy : 0.00606846809387207 nb_pixel_total : 4192 time to create 1 rle with old method : 0.0044672489166259766 time for calcul the mask position with numpy : 0.005697488784790039 nb_pixel_total : 14143 time to create 1 rle with old method : 0.015935659408569336 time for calcul the mask position with numpy : 0.0063629150390625 nb_pixel_total : 22682 time to create 1 rle with old method : 0.024770021438598633 time for calcul the mask position with numpy : 0.006205081939697266 nb_pixel_total : 26127 time to create 1 rle with old method : 0.028733253479003906 time for calcul the mask position with numpy : 0.012318134307861328 nb_pixel_total : 16382 time to create 1 rle with old method : 0.017919540405273438 time for calcul the mask position with numpy : 0.009906768798828125 nb_pixel_total : 12721 time to create 1 rle with old method : 0.013861656188964844 time for calcul the mask position with numpy : 0.010182619094848633 nb_pixel_total : 2950 time to create 1 rle with old method : 0.003270864486694336 create new chi : 0.5861215591430664 time to delete rle : 0.0009586811065673828 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 3738 TO DO : save crop sub photo not yet done ! save time : 0.24921369552612305 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 0.16749024391174316 time for calcul the mask position with numpy : 0.07775330543518066 nb_pixel_total : 1910961 time to create 1 rle with new method : 0.12750911712646484 time for calcul the mask position with numpy : 0.006223440170288086 nb_pixel_total : 19123 time to create 1 rle with old method : 0.02083277702331543 time for calcul the mask position with numpy : 0.0060312747955322266 nb_pixel_total : 3290 time to create 1 rle with old method : 0.0034379959106445312 time for calcul the mask position with numpy : 0.0059740543365478516 nb_pixel_total : 4929 time to create 1 rle with old method : 0.005287885665893555 time for calcul the mask position with numpy : 0.005971193313598633 nb_pixel_total : 3615 time to create 1 rle with old method : 0.003919839859008789 time for calcul the mask position with numpy : 0.006072998046875 nb_pixel_total : 13185 time to create 1 rle with old method : 0.01430964469909668 time for calcul the mask position with numpy : 0.006494283676147461 nb_pixel_total : 81293 time to create 1 rle with old method : 0.0848855972290039 time for calcul the mask position with numpy : 0.006062746047973633 nb_pixel_total : 8579 time to create 1 rle with old method : 0.008956670761108398 time for calcul the mask position with numpy : 0.005822181701660156 nb_pixel_total : 6227 time to create 1 rle with old method : 0.0064928531646728516 time for calcul the mask position with numpy : 0.005673408508300781 nb_pixel_total : 6070 time to create 1 rle with old method : 0.0064160823822021484 time for calcul the mask position with numpy : 0.005677938461303711 nb_pixel_total : 7492 time to create 1 rle with old method : 0.007994651794433594 time for calcul the mask position with numpy : 0.005952119827270508 nb_pixel_total : 8836 time to create 1 rle with old method : 0.009341716766357422 create new chi : 0.45325708389282227 time to delete rle : 0.0005483627319335938 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++Number RLEs to save : 4238 TO DO : save crop sub photo not yet done ! save time : 0.2605922222137451 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.03806138038635254 time for calcul the mask position with numpy : 0.018742084503173828 nb_pixel_total : 2046286 time to create 1 rle with new method : 0.027086257934570312 time for calcul the mask position with numpy : 0.0057561397552490234 nb_pixel_total : 20223 time to create 1 rle with old method : 0.02123117446899414 time for calcul the mask position with numpy : 0.0059223175048828125 nb_pixel_total : 7091 time to create 1 rle with old method : 0.007555246353149414 create new chi : 0.08654618263244629 time to delete rle : 0.00024700164794921875 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1522 TO DO : save crop sub photo not yet done ! save time : 0.1223456859588623 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.048494815826416016 time for calcul the mask position with numpy : 0.028343915939331055 nb_pixel_total : 2053125 time to create 1 rle with new method : 0.17674946784973145 time for calcul the mask position with numpy : 0.005940914154052734 nb_pixel_total : 20475 time to create 1 rle with old method : 0.021379947662353516 create new chi : 0.24293231964111328 time to delete rle : 0.00023627281188964844 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1526 TO DO : save crop sub photo not yet done ! save time : 0.1307666301727295 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.20505523681640625 time for calcul the mask position with numpy : 0.06494021415710449 nb_pixel_total : 1728704 time to create 1 rle with new method : 0.2114725112915039 time for calcul the mask position with numpy : 0.007752656936645508 nb_pixel_total : 336428 time to create 1 rle with new method : 0.2435305118560791 time for calcul the mask position with numpy : 0.005864143371582031 nb_pixel_total : 8468 time to create 1 rle with old method : 0.008818626403808594 create new chi : 0.5524837970733643 time to delete rle : 0.00042510032653808594 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2978 TO DO : save crop sub photo not yet done ! save time : 0.20282697677612305 map_output_result : {1376643665: (0.0, 'Should be the crop_list due to order', 0), 1376643320: (0.0, 'Should be the crop_list due to order', 0), 1376643261: (0.0, 'Should be the crop_list due to order', 0), 1376643201: (0.0, 'Should be the crop_list due to order', 0), 1376643135: (0.0, 'Should be the crop_list due to order', 0), 1376643078: (0.0, 'Should be the crop_list due to order', 0), 1376643015: (0.0, 'Should be the crop_list due to order', 0), 1376642638: (0.0, 'Should be the crop_list due to order', 0), 1376642602: (0.0, 'Should be the crop_list due to order', 0), 1376642560: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1376643665, 1376643320, 1376643261, 1376643201, 1376643135, 1376643078, 1376643015, 1376642638, 1376642602, 1376642560] Looping around the photos to save general results len do output : 10 /1376643665.Didn't retrieve data . /1376643320.Didn't retrieve data . /1376643261.Didn't retrieve data . /1376643201.Didn't retrieve data . /1376643135.Didn't retrieve data . /1376643078.Didn't retrieve data . /1376643015.Didn't retrieve data . /1376642638.Didn't retrieve data . /1376642602.Didn't retrieve data . /1376642560.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643665', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643320', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643261', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643201', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643135', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643078', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643015', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376642638', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376642602', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376642560', None, None, None, None, None, '3515065') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.013443231582641602 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.823513746261597 time spend to save output : 0.013861656188964844 total time spend for step 3 : 7.8373754024505615 step4:ventilate_hashtags_in_portfolio Tue Aug 12 17:41:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25922590 get user id for portfolio 25922590 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25922590 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','pet_clair','carton','papier','pet_fonce','flou','environnement','pehd','autre','metal','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25922590 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','pet_clair','carton','papier','pet_fonce','flou','environnement','pehd','autre','metal','mal_croppe')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25922590 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','pet_clair','carton','papier','pet_fonce','flou','environnement','pehd','autre','metal','mal_croppe')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25922628,25922629,25922630,25922631,25922632,25922633,25922634,25922635,25922636,25922637,25922638?tags=background,pet_clair,carton,papier,pet_fonce,flou,environnement,pehd,autre,metal,mal_croppe Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1376643665, 1376643320, 1376643261, 1376643201, 1376643135, 1376643078, 1376643015, 1376642638, 1376642602, 1376642560] Looping around the photos to save general results len do output : 1 /25922590. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643665', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643320', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643261', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643201', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643135', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643078', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643015', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376642638', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376642602', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376642560', None, None, None, None, None, '3515065') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.012949705123901367 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6366910934448242 time spend to save output : 0.01320791244506836 total time spend for step 4 : 1.6498990058898926 step5:final Tue Aug 12 17:41:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1376643665: ('0.0516502700617284',), 1376643320: ('0.0516502700617284',), 1376643261: ('0.0516502700617284',), 1376643201: ('0.0516502700617284',), 1376643135: ('0.0516502700617284',), 1376643078: ('0.0516502700617284',), 1376643015: ('0.0516502700617284',), 1376642638: ('0.0516502700617284',), 1376642602: ('0.0516502700617284',), 1376642560: ('0.0516502700617284',)} new output for save of step final : {1376643665: ('0.0516502700617284',), 1376643320: ('0.0516502700617284',), 1376643261: ('0.0516502700617284',), 1376643201: ('0.0516502700617284',), 1376643135: ('0.0516502700617284',), 1376643078: ('0.0516502700617284',), 1376643015: ('0.0516502700617284',), 1376642638: ('0.0516502700617284',), 1376642602: ('0.0516502700617284',), 1376642560: ('0.0516502700617284',)} [1376643665, 1376643320, 1376643261, 1376643201, 1376643135, 1376643078, 1376643015, 1376642638, 1376642602, 1376642560] Looping around the photos to save general results len do output : 10 /1376643665.Didn't retrieve data . /1376643320.Didn't retrieve data . /1376643261.Didn't retrieve data . /1376643201.Didn't retrieve data . /1376643135.Didn't retrieve data . /1376643078.Didn't retrieve data . /1376643015.Didn't retrieve data . /1376642638.Didn't retrieve data . /1376642602.Didn't retrieve data . /1376642560.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643665', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643320', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643261', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643201', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643135', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643078', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643015', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376642638', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376642602', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376642560', None, None, None, None, None, '3515065') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.013275861740112305 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11612319946289062 time spend to save output : 0.013769865036010742 total time spend for step 5 : 0.12989306449890137 step6:blur_detection Tue Aug 12 17:41:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1755013228_1378438_1376643665_9f4f49075992e5651ffa21a323b6ca7b.jpg resize: (1080, 1920) 1376643665 1.9124219896357662 treat image : temp/1755013228_1378438_1376643320_194a4ac5ad5b9500dbb3259408b55918.jpg resize: (1080, 1920) 1376643320 -0.2913242397821435 treat image : temp/1755013228_1378438_1376643261_d49cc630917c5b1c0e0be0da24a61784.jpg resize: (1080, 1920) 1376643261 -4.452605938022868 treat image : temp/1755013228_1378438_1376643201_d82ff05b32a0ed7ab2ac3ff99d027383.jpg resize: (1080, 1920) 1376643201 1.904294333662655 treat image : temp/1755013228_1378438_1376643135_4876d6afed82e34559734e444166c86c.jpg resize: (1080, 1920) 1376643135 -2.716402851691102 treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6.jpg resize: (1080, 1920) 1376643078 0.5787559890339791 treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36.jpg resize: (1080, 1920) 1376643015 -0.38391804365496385 treat image : temp/1755013228_1378438_1376642638_88dc8df5cd0b6bb02e08a003586547f9.jpg resize: (1080, 1920) 1376642638 0.6947503359484719 treat image : temp/1755013228_1378438_1376642602_9cfecb01bfea4d8af7b5645e2180955f.jpg resize: (1080, 1920) 1376642602 -0.7024006260202366 treat image : temp/1755013228_1378438_1376642560_009073f0ca51048d6fa553eef64658e9.jpg resize: (1080, 1920) 1376642560 1.1203435834252322 treat image : temp/1755013228_1378438_1376643665_9f4f49075992e5651ffa21a323b6ca7b_rle_crop_3912336743_0.png resize: (80, 151) 1376652073 -1.9890294838613936 treat image : temp/1755013228_1378438_1376643320_194a4ac5ad5b9500dbb3259408b55918_rle_crop_3912336746_0.png resize: (149, 140) 1376652074 -0.38782530362401324 treat image : temp/1755013228_1378438_1376643320_194a4ac5ad5b9500dbb3259408b55918_rle_crop_3912336747_0.png resize: (179, 182) 1376652075 0.2329044567051279 treat image : temp/1755013228_1378438_1376643261_d49cc630917c5b1c0e0be0da24a61784_rle_crop_3912336754_0.png resize: (98, 133) 1376652076 -4.153029239038764 treat image : temp/1755013228_1378438_1376643261_d49cc630917c5b1c0e0be0da24a61784_rle_crop_3912336753_0.png resize: (135, 61) 1376652077 -4.0825356546511395 treat image : temp/1755013228_1378438_1376643201_d82ff05b32a0ed7ab2ac3ff99d027383_rle_crop_3912336757_0.png resize: (141, 37) 1376652078 -0.8963118672010605 treat image : temp/1755013228_1378438_1376643201_d82ff05b32a0ed7ab2ac3ff99d027383_rle_crop_3912336755_0.png resize: (170, 141) 1376652079 -1.1108998874029916 treat image : temp/1755013228_1378438_1376643135_4876d6afed82e34559734e444166c86c_rle_crop_3912336761_0.png resize: (74, 97) 1376652080 -3.0417852605045756 treat image : temp/1755013228_1378438_1376643135_4876d6afed82e34559734e444166c86c_rle_crop_3912336759_0.png resize: (98, 179) 1376652081 -1.0681413898145016 treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336772_0.png resize: (74, 260) 1376652082 -1.5332139852761493 treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336773_0.png resize: (105, 151) 1376652083 0.345896990859414 treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336764_0.png resize: (87, 174) 1376652084 1.8385838126101188 treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336767_0.png resize: (180, 194) 1376652085 -0.7554802899415632 treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336766_0.png resize: (159, 275) 1376652086 -1.4319198307434275 treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336770_0.png resize: (141, 97) 1376652087 -0.04885641486549262 treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336771_0.png resize: (70, 67) 1376652088 -0.7591753703104599 treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336765_0.png resize: (134, 186) 1376652089 -1.621505584092955 treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336763_0.png resize: (60, 63) 1376652090 4.617541228487797 treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336782_0.png resize: (130, 121) 1376652091 -1.0808784085963248 treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336784_0.png resize: (109, 235) 1376652092 -2.214398040599567 treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336778_0.png resize: (128, 90) 1376652093 -0.5236447645447334 treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336774_0.png resize: (84, 170) 1376652094 -2.278737122220413 treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336777_0.png resize: (68, 109) 1376652095 3.2938864315121554 treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336783_0.png resize: (80, 62) 1376652096 -1.5676847265884395 treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336776_0.png resize: (69, 160) 1376652097 -2.609311756228703 treat image : temp/1755013228_1378438_1376642602_9cfecb01bfea4d8af7b5645e2180955f_rle_crop_3912336787_0.png resize: (205, 157) 1376652098 -0.4168583092815518 treat image : temp/1755013228_1378438_1376642560_009073f0ca51048d6fa553eef64658e9_rle_crop_3912336788_0.png resize: (169, 81) 1376652099 -0.25438848683986587 treat image : temp/1755013228_1378438_1376643261_d49cc630917c5b1c0e0be0da24a61784_rle_crop_3912336748_0.png resize: (80, 119) 1376652100 -2.9998798917212146 treat image : temp/1755013228_1378438_1376643261_d49cc630917c5b1c0e0be0da24a61784_rle_crop_3912336752_0.png resize: (163, 135) 1376652101 -1.4554930309851988 treat image : temp/1755013228_1378438_1376643261_d49cc630917c5b1c0e0be0da24a61784_rle_crop_3912336750_0.png resize: (83, 110) 1376652102 1.2643546569576867 treat image : temp/1755013228_1378438_1376643201_d82ff05b32a0ed7ab2ac3ff99d027383_rle_crop_3912336756_0.png resize: (144, 38) 1376652103 -0.996868723049394 treat image : temp/1755013228_1378438_1376643135_4876d6afed82e34559734e444166c86c_rle_crop_3912336758_0.png resize: (203, 162) 1376652104 -1.4420225345912794 treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336768_0.png resize: (174, 103) 1376652105 -0.3666828063849421 treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336780_0.png resize: (174, 188) 1376652106 -2.4784336847940365 treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336775_0.png resize: (115, 77) 1376652107 1.1847414562034226 treat image : temp/1755013228_1378438_1376642638_88dc8df5cd0b6bb02e08a003586547f9_rle_crop_3912336785_0.png resize: (107, 102) 1376652108 -1.1001438514103852 treat image : temp/1755013228_1378438_1376643665_9f4f49075992e5651ffa21a323b6ca7b_rle_crop_3912336744_0.png resize: (71, 76) 1376652109 -2.828882768093906 treat image : temp/1755013228_1378438_1376643665_9f4f49075992e5651ffa21a323b6ca7b_rle_crop_3912336745_0.png resize: (507, 334) 1376652115 -0.3573996689972922 treat image : temp/1755013228_1378438_1376643261_d49cc630917c5b1c0e0be0da24a61784_rle_crop_3912336751_0.png resize: (65, 135) 1376652116 -1.7296136746026403 treat image : temp/1755013228_1378438_1376643261_d49cc630917c5b1c0e0be0da24a61784_rle_crop_3912336749_0.png resize: (505, 337) 1376652117 0.22460955987109832 treat image : temp/1755013228_1378438_1376643135_4876d6afed82e34559734e444166c86c_rle_crop_3912336760_0.png resize: (109, 260) 1376652118 -3.6064063972710714 treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336781_0.png resize: (68, 73) 1376652119 -0.41330991963426955 treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336779_0.png resize: (457, 338) 1376652120 -0.7985641809680246 treat image : temp/1755013228_1378438_1376642638_88dc8df5cd0b6bb02e08a003586547f9_rle_crop_3912336786_0.png resize: (111, 227) 1376652121 -1.6442384972436415 treat image : temp/1755013228_1378438_1376642560_009073f0ca51048d6fa553eef64658e9_rle_crop_3912336789_0.png resize: (644, 843) 1376652122 0.8897185038527793 treat image : temp/1755013228_1378438_1376643135_4876d6afed82e34559734e444166c86c_rle_crop_3912336762_0.png resize: (137, 128) 1376652123 -3.111558956398032 treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336769_0.png resize: (79, 84) 1376652124 -1.3524773346865258 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 57 time used for this insertion : 0.013396263122558594 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 57 time used for this insertion : 0.012909889221191406 save missing photos in datou_result : time spend for datou_step_exec : 8.545130014419556 time spend to save output : 0.030943632125854492 total time spend for step 6 : 8.57607364654541 step7:brightness Tue Aug 12 17:41:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1755013228_1378438_1376643665_9f4f49075992e5651ffa21a323b6ca7b.jpg treat image : temp/1755013228_1378438_1376643320_194a4ac5ad5b9500dbb3259408b55918.jpg treat image : temp/1755013228_1378438_1376643261_d49cc630917c5b1c0e0be0da24a61784.jpg treat image : temp/1755013228_1378438_1376643201_d82ff05b32a0ed7ab2ac3ff99d027383.jpg treat image : temp/1755013228_1378438_1376643135_4876d6afed82e34559734e444166c86c.jpg treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6.jpg treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36.jpg treat image : temp/1755013228_1378438_1376642638_88dc8df5cd0b6bb02e08a003586547f9.jpg treat image : temp/1755013228_1378438_1376642602_9cfecb01bfea4d8af7b5645e2180955f.jpg treat image : temp/1755013228_1378438_1376642560_009073f0ca51048d6fa553eef64658e9.jpg treat image : temp/1755013228_1378438_1376643665_9f4f49075992e5651ffa21a323b6ca7b_rle_crop_3912336743_0.png treat image : temp/1755013228_1378438_1376643320_194a4ac5ad5b9500dbb3259408b55918_rle_crop_3912336746_0.png treat image : temp/1755013228_1378438_1376643320_194a4ac5ad5b9500dbb3259408b55918_rle_crop_3912336747_0.png treat image : temp/1755013228_1378438_1376643261_d49cc630917c5b1c0e0be0da24a61784_rle_crop_3912336754_0.png treat image : temp/1755013228_1378438_1376643261_d49cc630917c5b1c0e0be0da24a61784_rle_crop_3912336753_0.png treat image : temp/1755013228_1378438_1376643201_d82ff05b32a0ed7ab2ac3ff99d027383_rle_crop_3912336757_0.png treat image : temp/1755013228_1378438_1376643201_d82ff05b32a0ed7ab2ac3ff99d027383_rle_crop_3912336755_0.png treat image : temp/1755013228_1378438_1376643135_4876d6afed82e34559734e444166c86c_rle_crop_3912336761_0.png treat image : temp/1755013228_1378438_1376643135_4876d6afed82e34559734e444166c86c_rle_crop_3912336759_0.png treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336772_0.png treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336773_0.png treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336764_0.png treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336767_0.png treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336766_0.png treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336770_0.png treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336771_0.png treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336765_0.png treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336763_0.png treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336782_0.png treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336784_0.png treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336778_0.png treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336774_0.png treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336777_0.png treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336783_0.png treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336776_0.png treat image : temp/1755013228_1378438_1376642602_9cfecb01bfea4d8af7b5645e2180955f_rle_crop_3912336787_0.png treat image : temp/1755013228_1378438_1376642560_009073f0ca51048d6fa553eef64658e9_rle_crop_3912336788_0.png treat image : temp/1755013228_1378438_1376643261_d49cc630917c5b1c0e0be0da24a61784_rle_crop_3912336748_0.png treat image : temp/1755013228_1378438_1376643261_d49cc630917c5b1c0e0be0da24a61784_rle_crop_3912336752_0.png treat image : temp/1755013228_1378438_1376643261_d49cc630917c5b1c0e0be0da24a61784_rle_crop_3912336750_0.png treat image : temp/1755013228_1378438_1376643201_d82ff05b32a0ed7ab2ac3ff99d027383_rle_crop_3912336756_0.png treat image : temp/1755013228_1378438_1376643135_4876d6afed82e34559734e444166c86c_rle_crop_3912336758_0.png treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336768_0.png treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336780_0.png treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336775_0.png treat image : temp/1755013228_1378438_1376642638_88dc8df5cd0b6bb02e08a003586547f9_rle_crop_3912336785_0.png treat image : temp/1755013228_1378438_1376643665_9f4f49075992e5651ffa21a323b6ca7b_rle_crop_3912336744_0.png treat image : temp/1755013228_1378438_1376643665_9f4f49075992e5651ffa21a323b6ca7b_rle_crop_3912336745_0.png treat image : temp/1755013228_1378438_1376643261_d49cc630917c5b1c0e0be0da24a61784_rle_crop_3912336751_0.png treat image : temp/1755013228_1378438_1376643261_d49cc630917c5b1c0e0be0da24a61784_rle_crop_3912336749_0.png treat image : temp/1755013228_1378438_1376643135_4876d6afed82e34559734e444166c86c_rle_crop_3912336760_0.png treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336781_0.png treat image : temp/1755013228_1378438_1376643015_6ce87daa682388018493a35611ad0d36_rle_crop_3912336779_0.png treat image : temp/1755013228_1378438_1376642638_88dc8df5cd0b6bb02e08a003586547f9_rle_crop_3912336786_0.png treat image : temp/1755013228_1378438_1376642560_009073f0ca51048d6fa553eef64658e9_rle_crop_3912336789_0.png treat image : temp/1755013228_1378438_1376643135_4876d6afed82e34559734e444166c86c_rle_crop_3912336762_0.png treat image : temp/1755013228_1378438_1376643078_8e8cb5f716a7d1bff5dcb7de570700e6_rle_crop_3912336769_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 57 time used for this insertion : 0.013574600219726562 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 57 time used for this insertion : 0.014862298965454102 save missing photos in datou_result : time spend for datou_step_exec : 2.3188462257385254 time spend to save output : 0.03323554992675781 total time spend for step 7 : 2.352081775665283 step8:velours_tree Tue Aug 12 17:41:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.14298462867736816 time spend to save output : 3.170967102050781e-05 total time spend for step 8 : 0.14301633834838867 step9:send_mail_cod Tue Aug 12 17:41:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25922590_12-08-2025_17_41_35.pdf 25922628 imagette259226281755013295 25922629 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette259226291755013295 25922630 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette259226301755013295 25922631 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette259226311755013296 25922632 imagette259226321755013297 25922633 imagette259226331755013297 25922635 imagette259226351755013297 25922636 change filename to text .change filename to text .imagette259226361755013297 25922637 change filename to text .imagette259226371755013297 25922638 imagette259226381755013297 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25922590 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25922628,25922629,25922630,25922631,25922632,25922633,25922634,25922635,25922636,25922637,25922638?tags=background,pet_clair,carton,papier,pet_fonce,flou,environnement,pehd,autre,metal,mal_croppe args[1376643665] : ((1376643665, 1.9124219896357662, 492688767), (1376643665, 0.19878388247972212, 2107752395), '0.0516502700617284') We are sending mail with results at report@fotonower.com args[1376643320] : ((1376643320, -0.2913242397821435, 492688767), (1376643320, 0.8769449927222046, 2107752395), '0.0516502700617284') We are sending mail with results at report@fotonower.com args[1376643261] : ((1376643261, -4.452605938022868, 492609224), (1376643261, 0.3588076210765605, 2107752395), '0.0516502700617284') We are sending mail with results at report@fotonower.com args[1376643201] : ((1376643201, 1.904294333662655, 492688767), (1376643201, 0.8221682688512758, 2107752395), '0.0516502700617284') We are sending mail with results at report@fotonower.com args[1376643135] : ((1376643135, -2.716402851691102, 492609224), (1376643135, 0.315617575610802, 2107752395), '0.0516502700617284') We are sending mail with results at report@fotonower.com args[1376643078] : ((1376643078, 0.5787559890339791, 492688767), (1376643078, 0.1580676967708622, 2107752395), '0.0516502700617284') We are sending mail with results at report@fotonower.com args[1376643015] : ((1376643015, -0.38391804365496385, 492688767), (1376643015, 0.32993955863101426, 2107752395), '0.0516502700617284') We are sending mail with results at report@fotonower.com args[1376642638] : ((1376642638, 0.6947503359484719, 492688767), (1376642638, 0.5651895052551206, 2107752395), '0.0516502700617284') We are sending mail with results at report@fotonower.com args[1376642602] : ((1376642602, -0.7024006260202366, 492688767), (1376642602, 0.3315795102301934, 2107752395), '0.0516502700617284') We are sending mail with results at report@fotonower.com args[1376642560] : ((1376642560, 1.1203435834252322, 492688767), (1376642560, 1.392732021919656, 2107752395), '0.0516502700617284') We are sending mail with results at report@fotonower.com refus_total : 0.0516502700617284 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25922590 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25922590_12-08-2025_17_41_35.pdf results_Auto_P25922590_12-08-2025_17_41_35.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25922590_12-08-2025_17_41_35.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25922590','results_Auto_P25922590_12-08-2025_17_41_35.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25922590_12-08-2025_17_41_35.pdf','pdf','','0.22','0.0516502700617284') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25922590

https://www.fotonower.com/image?json=false&list_photos_id=1376643665
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.9124219896357662)
https://www.fotonower.com/image?json=false&list_photos_id=1376643320
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376643261
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376643201
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.904294333662655)
https://www.fotonower.com/image?json=false&list_photos_id=1376643135
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376643078
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376643015
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376642638
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376642602
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1376642560
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1203435834252322)

Dans ces conditions,le taux de refus est: 5.17%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/25922629?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/25922630?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/25922631?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/25922636?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/25922637?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25922590_12-08-2025_17_41_35.pdf.

Lien vers velours :https://www.fotonower.com/velours/25922628,25922629,25922630,25922631,25922632,25922633,25922634,25922635,25922636,25922637,25922638?tags=background,pet_clair,carton,papier,pet_fonce,flou,environnement,pehd,autre,metal,mal_croppe.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 12 Aug 2025 15:41:39 GMT Content-Length: 0 Connection: close X-Message-Id: RJmV67wlR_uRfniVrreKSg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1376643665, 1376643320, 1376643261, 1376643201, 1376643135, 1376643078, 1376643015, 1376642638, 1376642602, 1376642560] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643665', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643320', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643261', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643201', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643135', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643078', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643015', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376642638', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376642602', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376642560', None, None, None, None, None, '3515065') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.012866497039794922 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.079307556152344 time spend to save output : 0.013049840927124023 total time spend for step 9 : 4.092357397079468 step10:split_time_score Tue Aug 12 17:41:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 12082025 25922590 Nombre de photos uploadées : 10 / 23040 (0%) 12082025 25922590 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 12082025 25922590 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 4.5299530029296875e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005095005035400391 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.19842815399169922 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.08963755666473765 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25907306_12-08-2025_12_02_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25907306 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25907306 AND mptpi.`type`=3594 To do Qualite : 0.2198127786351166 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25908856_12-08-2025_12_01_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25908856 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25908856 AND mptpi.`type`=3594 To do Qualite : 0.11567090446566358 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25908860_12-08-2025_13_02_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25908860 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25908860 AND mptpi.`type`=3594 To do Qualite : 0.03421356577932099 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25908864_12-08-2025_11_41_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25908864 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25908864 AND mptpi.`type`=3594 To do Qualite : 0.09985528962742503 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25907315_12-08-2025_12_41_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25907315 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25907315 AND mptpi.`type`=3594 To do Qualite : 0.24285493827160495 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25907317_12-08-2025_13_21_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25907317 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25907317 AND mptpi.`type`=3594 To do Qualite : 0.021655971995279587 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25907323_12-08-2025_11_22_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25907323 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25907323 AND mptpi.`type`=3594 To do Qualite : 0.06390883349867725 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25907331_12-08-2025_12_21_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25907331 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25907331 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25922558 order by id desc limit 1 Qualite : 0.019449749228395066 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915171_12-08-2025_15_11_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25915171 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25915171 AND mptpi.`type`=3594 To do Qualite : 0.0699012163204872 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915172_12-08-2025_15_03_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25915172 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25915172 AND mptpi.`type`=3594 To do Qualite : 0.15671019000771605 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25915175_12-08-2025_16_02_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25915175 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25915175 AND mptpi.`type`=3594 To do Qualite : 0.1134959072181458 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25921213_12-08-2025_17_35_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25921213 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25921213 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25921219 order by id desc limit 1 Qualite : 0.1663350080667789 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25921229_12-08-2025_17_11_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25921229 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25921229 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25922565 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25922569 order by id desc limit 1 Qualite : 0.0516502700617284 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25922590_12-08-2025_17_41_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25922590 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25922590 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'12082025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1376643665, 1376643320, 1376643261, 1376643201, 1376643135, 1376643078, 1376643015, 1376642638, 1376642602, 1376642560] Looping around the photos to save general results len do output : 1 /25922590Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643665', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643320', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643261', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643201', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643135', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643078', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376643015', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376642638', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376642602', None, None, None, None, None, '3515065') ('3318', None, None, None, None, None, None, None, '3515065') ('3318', '25922590', '1376642560', None, None, None, None, None, '3515065') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.013284444808959961 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.993152141571045 time spend to save output : 0.013445377349853516 total time spend for step 10 : 5.006597518920898 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 34.79user 19.16system 1:18.31elapsed 68%CPU (0avgtext+0avgdata 2929716maxresident)k 333456inputs+15432outputs (75major+1641751minor)pagefaults 0swaps