python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2033379 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3903209'] with mtr_portfolio_ids : ['27641624'] and first list_photo_ids : [] new path : /proc/2033379/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 17 ; length of list_pids : 17 ; length of list_args : 17 time to download the photos : 2.964986562728882 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu Oct 9 12:20:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4361 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-10-09 12:20:37.212232: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-10-09 12:20:37.238427: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-10-09 12:20:37.240646: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f482c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-10-09 12:20:37.240705: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-10-09 12:20:37.244799: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-10-09 12:20:37.464612: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x362454e0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-10-09 12:20:37.464662: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-10-09 12:20:37.465745: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-09 12:20:37.466170: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-09 12:20:37.469236: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-09 12:20:37.472259: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-09 12:20:37.472781: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-09 12:20:37.476339: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-09 12:20:37.478068: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-09 12:20:37.482919: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-09 12:20:37.483998: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-09 12:20:37.484084: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-09 12:20:37.484647: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-09 12:20:37.484663: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-09 12:20:37.484671: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-09 12:20:37.485601: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3909 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-10-09 12:20:37.883046: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-09 12:20:37.883191: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-09 12:20:37.883223: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-09 12:20:37.883253: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-09 12:20:37.883280: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-09 12:20:37.883308: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-09 12:20:37.883335: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-09 12:20:37.883363: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-09 12:20:37.884211: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-09 12:20:37.885199: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-09 12:20:37.885230: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-09 12:20:37.885245: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-09 12:20:37.885259: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-09 12:20:37.885272: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-09 12:20:37.885286: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-09 12:20:37.885299: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-09 12:20:37.885313: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-09 12:20:37.886202: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-09 12:20:37.886237: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-09 12:20:37.886246: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-09 12:20:37.886254: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-09 12:20:37.887137: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3909 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-10-09 12:20:44.813714: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-09 12:20:44.997740: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-09 12:20:46.289355: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.099186: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-10-09 12:20:47.174344: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.174406: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-09 12:20:47.198827: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.198853: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-09 12:20:47.205459: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.205483: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-09 12:20:47.206301: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.206324: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-09 12:20:47.250943: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.250966: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-09 12:20:47.251571: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.251586: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-09 12:20:47.252185: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.252200: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-09 12:20:47.252789: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.252803: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-09 12:20:47.260492: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.260510: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 417.62MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-09 12:20:47.261101: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.261115: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 417.62MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-09 12:20:47.276274: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.277211: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.278111: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.279018: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.283092: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.283686: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.284276: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.284868: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.285941: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.285957: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-10-09 12:20:47.296079: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.296668: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.305577: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.306173: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.306789: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.307381: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.307978: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-09 12:20:47.308722: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.32G (3563978752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 17 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 Detection mask done ! Trying to reset tf kernel 2033937 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3168 tf kernel not reseted sub process len(results) : 17 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 17 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4361 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0010945796966552734 nb_pixel_total : 51416 time to create 1 rle with old method : 0.057016611099243164 length of segment : 265 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 2099 time to create 1 rle with old method : 0.0024178028106689453 length of segment : 52 time for calcul the mask position with numpy : 0.00019860267639160156 nb_pixel_total : 10410 time to create 1 rle with old method : 0.012065887451171875 length of segment : 197 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 3294 time to create 1 rle with old method : 0.0039212703704833984 length of segment : 55 time for calcul the mask position with numpy : 0.001531362533569336 nb_pixel_total : 102284 time to create 1 rle with old method : 0.11004471778869629 length of segment : 549 time for calcul the mask position with numpy : 0.023501157760620117 nb_pixel_total : 1431306 time to create 1 rle with new method : 0.040209054946899414 length of segment : 1317 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 1551 time to create 1 rle with old method : 0.0017538070678710938 length of segment : 56 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 3428 time to create 1 rle with old method : 0.0037910938262939453 length of segment : 64 time for calcul the mask position with numpy : 0.0007405281066894531 nb_pixel_total : 51688 time to create 1 rle with old method : 0.055469512939453125 length of segment : 361 time for calcul the mask position with numpy : 0.00010275840759277344 nb_pixel_total : 5432 time to create 1 rle with old method : 0.0060367584228515625 length of segment : 109 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 2577 time to create 1 rle with old method : 0.0031108856201171875 length of segment : 35 time for calcul the mask position with numpy : 0.009401321411132812 nb_pixel_total : 787325 time to create 1 rle with new method : 0.025320768356323242 length of segment : 990 time for calcul the mask position with numpy : 9.417533874511719e-05 nb_pixel_total : 4022 time to create 1 rle with old method : 0.004434347152709961 length of segment : 77 time for calcul the mask position with numpy : 0.0015606880187988281 nb_pixel_total : 122301 time to create 1 rle with old method : 0.13107967376708984 length of segment : 557 time for calcul the mask position with numpy : 0.0002353191375732422 nb_pixel_total : 5132 time to create 1 rle with old method : 0.005956411361694336 length of segment : 91 time for calcul the mask position with numpy : 0.0002028942108154297 nb_pixel_total : 8152 time to create 1 rle with old method : 0.009669065475463867 length of segment : 47 time for calcul the mask position with numpy : 0.0001919269561767578 nb_pixel_total : 5774 time to create 1 rle with old method : 0.006379127502441406 length of segment : 100 time for calcul the mask position with numpy : 0.00028228759765625 nb_pixel_total : 8669 time to create 1 rle with old method : 0.009555816650390625 length of segment : 142 time for calcul the mask position with numpy : 0.0002837181091308594 nb_pixel_total : 10238 time to create 1 rle with old method : 0.01120448112487793 length of segment : 154 time for calcul the mask position with numpy : 0.011194229125976562 nb_pixel_total : 726337 time to create 1 rle with new method : 0.022524356842041016 length of segment : 984 time for calcul the mask position with numpy : 0.010410070419311523 nb_pixel_total : 729657 time to create 1 rle with new method : 0.016764402389526367 length of segment : 942 time for calcul the mask position with numpy : 0.00022530555725097656 nb_pixel_total : 7304 time to create 1 rle with old method : 0.00844430923461914 length of segment : 90 time for calcul the mask position with numpy : 0.00023126602172851562 nb_pixel_total : 7391 time to create 1 rle with old method : 0.008142948150634766 length of segment : 98 time for calcul the mask position with numpy : 0.0002715587615966797 nb_pixel_total : 8787 time to create 1 rle with old method : 0.011190652847290039 length of segment : 101 time for calcul the mask position with numpy : 0.00038504600524902344 nb_pixel_total : 15387 time to create 1 rle with old method : 0.01702737808227539 length of segment : 119 time for calcul the mask position with numpy : 0.002538919448852539 nb_pixel_total : 107395 time to create 1 rle with old method : 0.1128396987915039 length of segment : 547 time for calcul the mask position with numpy : 0.00022101402282714844 nb_pixel_total : 6281 time to create 1 rle with old method : 0.006925106048583984 length of segment : 111 time for calcul the mask position with numpy : 0.00020194053649902344 nb_pixel_total : 9410 time to create 1 rle with old method : 0.010507583618164062 length of segment : 110 time for calcul the mask position with numpy : 0.00019812583923339844 nb_pixel_total : 6823 time to create 1 rle with old method : 0.0075778961181640625 length of segment : 85 time for calcul the mask position with numpy : 0.0017473697662353516 nb_pixel_total : 94007 time to create 1 rle with old method : 0.0995631217956543 length of segment : 552 time for calcul the mask position with numpy : 0.0002560615539550781 nb_pixel_total : 3922 time to create 1 rle with old method : 0.004518747329711914 length of segment : 130 time for calcul the mask position with numpy : 0.0002148151397705078 nb_pixel_total : 4245 time to create 1 rle with old method : 0.005204677581787109 length of segment : 83 time for calcul the mask position with numpy : 0.00020122528076171875 nb_pixel_total : 4125 time to create 1 rle with old method : 0.0049588680267333984 length of segment : 89 time for calcul the mask position with numpy : 0.0004210472106933594 nb_pixel_total : 14876 time to create 1 rle with old method : 0.01659703254699707 length of segment : 246 time spent for convertir_results : 2.7453644275665283 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 34 chid ids of type : 3594 Number RLEs to save : 9505 save missing photos in datou_result : time spend for datou_step_exec : 23.648813247680664 time spend to save output : 1.196507215499878 total time spend for step 1 : 24.845320463180542 step2:crop_condition Thu Oct 9 12:20:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 17 ! batch 1 Loaded 34 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760005260_2033379 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005261), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238802_3582e7ab11328d7470b4096c12291e42_rle_crop_3990401654_0.png', 0, 132, 172, 0, 1760005261,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005261), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238797_041b2b5ab097e0373802a098a0c11ae4_rle_crop_3990401658_0.png', 0, 32, 56, 0, 1760005261,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005261), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238769_0cd43123d36bf8d36e9a85328cf155ab_rle_crop_3990401662_0.png', 0, 116, 34, 0, 1760005261,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005261), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238766_4e114885786830e39e74dbf28008b350_rle_crop_3990401664_0.png', 0, 78, 77, 0, 1760005261,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005261), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238760_0f64d9b3bf88ee40986484efe31c38d7_rle_crop_3990401666_0.png', 0, 82, 91, 0, 1760005261,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005261), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238734_3bc42ddac90e5aa965d61b57264f1911_rle_crop_3990401673_0.png', 0, 114, 88, 0, 1760005261,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.3992226123809814 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760005263_2033379 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005264), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238756_b809525949b3435b557bf6f69604e96d_rle_crop_3990401668_0.png', 0, 85, 100, 0, 1760005264,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005264), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238756_b809525949b3435b557bf6f69604e96d_rle_crop_3990401669_0.png', 0, 87, 142, 0, 1760005264,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005264), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238754_c11935f86c2493a496614c3c4317c9e8_rle_crop_3990401670_0.png', 0, 121, 123, 0, 1760005264,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005264), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238734_3bc42ddac90e5aa965d61b57264f1911_rle_crop_3990401675_0.png', 0, 151, 96, 0, 1760005264,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005264), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238726_4936300469de14b0605f434b3ab92c6b_rle_crop_3990401680_0.png', 0, 100, 85, 0, 1760005264,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005264), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238702_11014c67bcc22a2b4e5cd68faed2d327_rle_crop_3990401684_0.png', 0, 83, 87, 0, 1760005264,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.4146878719329834 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760005266_2033379 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005266), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238726_4936300469de14b0605f434b3ab92c6b_rle_crop_3990401678_0.png', 0, 83, 111, 0, 1760005266,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005266), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238726_4936300469de14b0605f434b3ab92c6b_rle_crop_3990401679_0.png', 0, 150, 97, 0, 1760005266,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005266), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238716_c1e639966656cf71d5ad763ac684fab4_rle_crop_3990401683_0.png', 0, 63, 83, 0, 1760005266,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.3214550018310547 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! About to upload 17 photos upload in portfolio : 3736932 init cache_photo without model_param we have 17 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760005283_2033379 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005287), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238806_0b6d8ee7ea3fd8f22f11fc1e2bd3bca6_rle_crop_3990401652_0.png', 0, 259, 259, 0, 1760005287,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005287), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238802_3582e7ab11328d7470b4096c12291e42_rle_crop_3990401655_0.png', 0, 82, 55, 0, 1760005287,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005287), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238797_041b2b5ab097e0373802a098a0c11ae4_rle_crop_3990401657_0.png', 0, 1607, 1007, 0, 1760005287,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005287), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238797_041b2b5ab097e0373802a098a0c11ae4_rle_crop_3990401656_0.png', 0, 358, 505, 0, 1760005287,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005287), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238784_83dcd2812a680cabbeb3621ce0e9b6ce_rle_crop_3990401659_0.png', 0, 69, 64, 0, 1760005287,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005287), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238784_83dcd2812a680cabbeb3621ce0e9b6ce_rle_crop_3990401661_0.png', 0, 65, 109, 0, 1760005287,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005287), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238784_83dcd2812a680cabbeb3621ce0e9b6ce_rle_crop_3990401660_0.png', 0, 215, 361, 0, 1760005287,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005287), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238766_4e114885786830e39e74dbf28008b350_rle_crop_3990401663_0.png', 0, 1105, 980, 0, 1760005287,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005287), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238760_0f64d9b3bf88ee40986484efe31c38d7_rle_crop_3990401667_0.png', 0, 216, 46, 0, 1760005287,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005287), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238760_0f64d9b3bf88ee40986484efe31c38d7_rle_crop_3990401665_0.png', 0, 376, 552, 0, 1760005287,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005287), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238754_c11935f86c2493a496614c3c4317c9e8_rle_crop_3990401671_0.png', 0, 980, 972, 0, 1760005287,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005287), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238752_7764a0bf2aca0bd8c587a67abe502617_rle_crop_3990401672_0.png', 0, 1017, 939, 0, 1760005287,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005287), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238734_3bc42ddac90e5aa965d61b57264f1911_rle_crop_3990401674_0.png', 0, 99, 97, 0, 1760005287,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005287), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238732_921201c484a1c13e4a8991b75b4a140a_rle_crop_3990401676_0.png', 0, 169, 117, 0, 1760005287,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005287), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238732_921201c484a1c13e4a8991b75b4a140a_rle_crop_3990401677_0.png', 0, 358, 526, 0, 1760005287,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005287), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238726_4936300469de14b0605f434b3ab92c6b_rle_crop_3990401681_0.png', 0, 338, 523, 0, 1760005287,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005287), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238702_11014c67bcc22a2b4e5cd68faed2d327_rle_crop_3990401685_0.png', 0, 135, 201, 0, 1760005287,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 17 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.037256479263306 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760005290_2033379 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005290), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238802_3582e7ab11328d7470b4096c12291e42_rle_crop_3990401653_0.png', 0, 52, 51, 0, 1760005290,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760005290), 0.0, 0.0, 14, '', 0, 0, '1760005231_2033379_1388238716_c1e639966656cf71d5ad763ac684fab4_rle_crop_3990401682_0.png', 0, 44, 130, 0, 1760005290,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0404701232910156 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1388238806, 1388238802, 1388238797, 1388238791, 1388238784, 1388238769, 1388238766, 1388238760, 1388238756, 1388238754, 1388238752, 1388238734, 1388238732, 1388238726, 1388238716, 1388238702, 1388238689] Looping around the photos to save general results len do output : 34 /1388386183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1388386773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238806', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238802', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238797', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238791', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238784', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238769', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238766', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238760', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238756', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238754', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238752', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238734', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238732', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238726', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238716', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238702', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238689', None, None, None, None, None, '3903209') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 119 time used for this insertion : 0.0406796932220459 save_final save missing photos in datou_result : time spend for datou_step_exec : 31.48206901550293 time spend to save output : 0.04229474067687988 total time spend for step 2 : 31.52436375617981 step3:rle_unique_nms_with_priority Thu Oct 9 12:21:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 34 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.06427669525146484 time for calcul the mask position with numpy : 0.023983001708984375 nb_pixel_total : 2022184 time to create 1 rle with new method : 0.03968071937561035 time for calcul the mask position with numpy : 0.006357669830322266 nb_pixel_total : 51416 time to create 1 rle with old method : 0.055768728256225586 create new chi : 0.13027405738830566 time to delete rle : 0.08508729934692383 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1610 TO DO : save crop sub photo not yet done ! save time : 0.3331022262573242 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.0671243667602539 time for calcul the mask position with numpy : 0.05126214027404785 nb_pixel_total : 2057797 time to create 1 rle with new method : 0.5049245357513428 time for calcul the mask position with numpy : 0.0056917667388916016 nb_pixel_total : 3294 time to create 1 rle with old method : 0.003420591354370117 time for calcul the mask position with numpy : 0.0063478946685791016 nb_pixel_total : 10410 time to create 1 rle with old method : 0.011502504348754883 time for calcul the mask position with numpy : 0.005900382995605469 nb_pixel_total : 2099 time to create 1 rle with old method : 0.0022847652435302734 create new chi : 0.600430965423584 time to delete rle : 0.0002923011779785156 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1688 TO DO : save crop sub photo not yet done ! save time : 0.3329176902770996 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.06519365310668945 time for calcul the mask position with numpy : 0.010089874267578125 nb_pixel_total : 540010 time to create 1 rle with new method : 0.0621340274810791 time for calcul the mask position with numpy : 0.015073776245117188 nb_pixel_total : 1431306 time to create 1 rle with new method : 0.039843082427978516 time for calcul the mask position with numpy : 0.006633281707763672 nb_pixel_total : 102284 time to create 1 rle with old method : 0.10797929763793945 create new chi : 0.24981045722961426 time to delete rle : 0.0005750656127929688 batch 1 Loaded 6 chid ids of type : 3594 +++++Number RLEs to save : 4812 TO DO : save crop sub photo not yet done ! save time : 0.6266751289367676 No data in photo_id : 1388238791 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.06857800483703613 time for calcul the mask position with numpy : 1.0622177124023438 nb_pixel_total : 2013052 time to create 1 rle with new method : 0.06910419464111328 time for calcul the mask position with numpy : 0.005702018737792969 nb_pixel_total : 5432 time to create 1 rle with old method : 0.00568079948425293 time for calcul the mask position with numpy : 0.00606846809387207 nb_pixel_total : 51688 time to create 1 rle with old method : 0.05328774452209473 time for calcul the mask position with numpy : 0.005741596221923828 nb_pixel_total : 3428 time to create 1 rle with old method : 0.003601551055908203 create new chi : 1.2193799018859863 time to delete rle : 0.0003609657287597656 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2148 TO DO : save crop sub photo not yet done ! save time : 0.39790940284729004 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.033280134201049805 time for calcul the mask position with numpy : 0.01880955696105957 nb_pixel_total : 2071023 time to create 1 rle with new method : 0.7154455184936523 time for calcul the mask position with numpy : 0.0057942867279052734 nb_pixel_total : 2577 time to create 1 rle with old method : 0.0026841163635253906 create new chi : 0.7474400997161865 time to delete rle : 0.0001735687255859375 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1150 TO DO : save crop sub photo not yet done ! save time : 0.28991079330444336 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04135870933532715 time for calcul the mask position with numpy : 0.016580581665039062 nb_pixel_total : 1282253 time to create 1 rle with new method : 0.07013940811157227 time for calcul the mask position with numpy : 0.006100177764892578 nb_pixel_total : 4022 time to create 1 rle with old method : 0.00445556640625 time for calcul the mask position with numpy : 0.011162996292114258 nb_pixel_total : 787325 time to create 1 rle with new method : 0.0440061092376709 create new chi : 0.15952301025390625 time to delete rle : 0.00030422210693359375 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3214 TO DO : save crop sub photo not yet done ! save time : 0.4799365997314453 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.058393239974975586 time for calcul the mask position with numpy : 0.09419107437133789 nb_pixel_total : 1938015 time to create 1 rle with new method : 0.7373611927032471 time for calcul the mask position with numpy : 0.005940437316894531 nb_pixel_total : 8152 time to create 1 rle with old method : 0.00876617431640625 time for calcul the mask position with numpy : 0.005685567855834961 nb_pixel_total : 5132 time to create 1 rle with old method : 0.005301713943481445 time for calcul the mask position with numpy : 0.006319522857666016 nb_pixel_total : 122301 time to create 1 rle with old method : 0.15733981132507324 create new chi : 1.030510425567627 time to delete rle : 0.0004858970642089844 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2470 TO DO : save crop sub photo not yet done ! save time : 0.3943350315093994 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04821348190307617 time for calcul the mask position with numpy : 0.01967000961303711 nb_pixel_total : 2059157 time to create 1 rle with new method : 0.06697988510131836 time for calcul the mask position with numpy : 0.005719423294067383 nb_pixel_total : 8669 time to create 1 rle with old method : 0.009149789810180664 time for calcul the mask position with numpy : 0.0056536197662353516 nb_pixel_total : 5774 time to create 1 rle with old method : 0.005966663360595703 create new chi : 0.11934757232666016 time to delete rle : 0.0002720355987548828 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1564 TO DO : save crop sub photo not yet done ! save time : 0.3130190372467041 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04572629928588867 time for calcul the mask position with numpy : 0.01794147491455078 nb_pixel_total : 1337025 time to create 1 rle with new method : 0.042836666107177734 time for calcul the mask position with numpy : 0.01132822036743164 nb_pixel_total : 726337 time to create 1 rle with new method : 0.039005279541015625 time for calcul the mask position with numpy : 0.005876302719116211 nb_pixel_total : 10238 time to create 1 rle with old method : 0.010856389999389648 create new chi : 0.13614988327026367 time to delete rle : 0.0004928112030029297 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3356 TO DO : save crop sub photo not yet done ! save time : 0.4741945266723633 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.042540788650512695 time for calcul the mask position with numpy : 0.01590728759765625 nb_pixel_total : 1343943 time to create 1 rle with new method : 0.03985738754272461 time for calcul the mask position with numpy : 0.011598348617553711 nb_pixel_total : 729657 time to create 1 rle with new method : 0.030762434005737305 create new chi : 0.10188484191894531 time to delete rle : 0.00029397010803222656 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2964 TO DO : save crop sub photo not yet done ! save time : 0.4264047145843506 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.05532217025756836 time for calcul the mask position with numpy : 0.8024048805236816 nb_pixel_total : 2050118 time to create 1 rle with new method : 0.07008934020996094 time for calcul the mask position with numpy : 0.0058443546295166016 nb_pixel_total : 8787 time to create 1 rle with old method : 0.009727716445922852 time for calcul the mask position with numpy : 0.005831480026245117 nb_pixel_total : 7391 time to create 1 rle with old method : 0.007853507995605469 time for calcul the mask position with numpy : 0.0055599212646484375 nb_pixel_total : 7304 time to create 1 rle with old method : 0.00795435905456543 create new chi : 0.9235897064208984 time to delete rle : 0.0003542900085449219 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1658 TO DO : save crop sub photo not yet done ! save time : 0.3345353603363037 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04995417594909668 time for calcul the mask position with numpy : 0.018340110778808594 nb_pixel_total : 1950818 time to create 1 rle with new method : 0.04412102699279785 time for calcul the mask position with numpy : 0.0067408084869384766 nb_pixel_total : 107395 time to create 1 rle with old method : 0.11179184913635254 time for calcul the mask position with numpy : 0.005791187286376953 nb_pixel_total : 15387 time to create 1 rle with old method : 0.016108274459838867 create new chi : 0.20662260055541992 time to delete rle : 0.0003719329833984375 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2412 TO DO : save crop sub photo not yet done ! save time : 0.3780701160430908 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.33030033111572266 time for calcul the mask position with numpy : 0.05740618705749512 nb_pixel_total : 1957079 time to create 1 rle with new method : 0.8872354030609131 time for calcul the mask position with numpy : 0.006426572799682617 nb_pixel_total : 94007 time to create 1 rle with old method : 0.09950375556945801 time for calcul the mask position with numpy : 0.0061762332916259766 nb_pixel_total : 6823 time to create 1 rle with old method : 0.00731348991394043 time for calcul the mask position with numpy : 0.005776405334472656 nb_pixel_total : 9410 time to create 1 rle with old method : 0.010039567947387695 time for calcul the mask position with numpy : 0.005640983581542969 nb_pixel_total : 6281 time to create 1 rle with old method : 0.0068836212158203125 create new chi : 1.1021757125854492 time to delete rle : 0.0002720355987548828 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 2796 TO DO : save crop sub photo not yet done ! save time : 0.48003053665161133 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.03893709182739258 time for calcul the mask position with numpy : 0.01882791519165039 nb_pixel_total : 2065433 time to create 1 rle with new method : 0.5611202716827393 time for calcul the mask position with numpy : 0.006188631057739258 nb_pixel_total : 4245 time to create 1 rle with old method : 0.004489898681640625 time for calcul the mask position with numpy : 0.005587100982666016 nb_pixel_total : 3922 time to create 1 rle with old method : 0.004293918609619141 create new chi : 0.6072771549224854 time to delete rle : 0.0003070831298828125 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1506 TO DO : save crop sub photo not yet done ! save time : 0.33291172981262207 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04134654998779297 time for calcul the mask position with numpy : 0.019727468490600586 nb_pixel_total : 2054599 time to create 1 rle with new method : 0.5881819725036621 time for calcul the mask position with numpy : 0.0061283111572265625 nb_pixel_total : 14876 time to create 1 rle with old method : 0.015906572341918945 time for calcul the mask position with numpy : 0.006066799163818359 nb_pixel_total : 4125 time to create 1 rle with old method : 0.004618167877197266 create new chi : 0.6475791931152344 time to delete rle : 0.0003046989440917969 batch 1 Loaded 5 chid ids of type : 3594 +++++Number RLEs to save : 1750 TO DO : save crop sub photo not yet done ! save time : 0.33239078521728516 No data in photo_id : 1388238689 map_output_result : {1388238806: (0.0, 'Should be the crop_list due to order', 0), 1388238802: (0.0, 'Should be the crop_list due to order', 0), 1388238797: (0.0, 'Should be the crop_list due to order', 0), 1388238791: (0.0, 'Should be the crop_list due to order', 0.0), 1388238784: (0.0, 'Should be the crop_list due to order', 0), 1388238769: (0.0, 'Should be the crop_list due to order', 0), 1388238766: (0.0, 'Should be the crop_list due to order', 0), 1388238760: (0.0, 'Should be the crop_list due to order', 0), 1388238756: (0.0, 'Should be the crop_list due to order', 0), 1388238754: (0.0, 'Should be the crop_list due to order', 0), 1388238752: (0.0, 'Should be the crop_list due to order', 0), 1388238734: (0.0, 'Should be the crop_list due to order', 0), 1388238732: (0.0, 'Should be the crop_list due to order', 0), 1388238726: (0.0, 'Should be the crop_list due to order', 0), 1388238716: (0.0, 'Should be the crop_list due to order', 0), 1388238702: (0.0, 'Should be the crop_list due to order', 0), 1388238689: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1388238806, 1388238802, 1388238797, 1388238791, 1388238784, 1388238769, 1388238766, 1388238760, 1388238756, 1388238754, 1388238752, 1388238734, 1388238732, 1388238726, 1388238716, 1388238702, 1388238689] Looping around the photos to save general results len do output : 17 /1388238806.Didn't retrieve data . /1388238802.Didn't retrieve data . /1388238797.Didn't retrieve data . /1388238791.Didn't retrieve data . /1388238784.Didn't retrieve data . /1388238769.Didn't retrieve data . /1388238766.Didn't retrieve data . /1388238760.Didn't retrieve data . /1388238756.Didn't retrieve data . /1388238754.Didn't retrieve data . /1388238752.Didn't retrieve data . /1388238734.Didn't retrieve data . /1388238732.Didn't retrieve data . /1388238726.Didn't retrieve data . /1388238716.Didn't retrieve data . /1388238702.Didn't retrieve data . /1388238689.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238806', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238802', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238797', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238791', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238784', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238769', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238766', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238760', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238756', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238754', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238752', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238734', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238732', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238726', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238716', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238702', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238689', None, None, None, None, None, '3903209') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 51 time used for this insertion : 0.03752589225769043 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.650501251220703 time spend to save output : 0.03837108612060547 total time spend for step 3 : 15.688872337341309 step4:ventilate_hashtags_in_portfolio Thu Oct 9 12:21:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 27641624 get user id for portfolio 27641624 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27641624 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','carton','pehd','environnement','mal_croppe','pet_clair','metal','background','pet_fonce','autre','papier')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27641624 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','carton','pehd','environnement','mal_croppe','pet_clair','metal','background','pet_fonce','autre','papier')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27641624 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','carton','pehd','environnement','mal_croppe','pet_clair','metal','background','pet_fonce','autre','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27642323,27642324,27642325,27642326,27642327,27642328,27642329,27642330,27642331,27642332,27642333?tags=flou,carton,pehd,environnement,mal_croppe,pet_clair,metal,background,pet_fonce,autre,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1388238806, 1388238802, 1388238797, 1388238791, 1388238784, 1388238769, 1388238766, 1388238760, 1388238756, 1388238754, 1388238752, 1388238734, 1388238732, 1388238726, 1388238716, 1388238702, 1388238689] Looping around the photos to save general results len do output : 1 /27641624. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238806', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238802', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238797', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238791', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238784', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238769', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238766', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238760', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238756', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238754', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238752', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238734', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238732', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238726', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238716', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238702', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238689', None, None, None, None, None, '3903209') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.040764808654785156 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.491871356964111 time spend to save output : 0.041078805923461914 total time spend for step 4 : 5.532950162887573 step5:final Thu Oct 9 12:21:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1388238806: ('0.12372611428830797',), 1388238802: ('0.12372611428830797',), 1388238797: ('0.12372611428830797',), 1388238791: ('0.12372611428830797',), 1388238784: ('0.12372611428830797',), 1388238769: ('0.12372611428830797',), 1388238766: ('0.12372611428830797',), 1388238760: ('0.12372611428830797',), 1388238756: ('0.12372611428830797',), 1388238754: ('0.12372611428830797',), 1388238752: ('0.12372611428830797',), 1388238734: ('0.12372611428830797',), 1388238732: ('0.12372611428830797',), 1388238726: ('0.12372611428830797',), 1388238716: ('0.12372611428830797',), 1388238702: ('0.12372611428830797',), 1388238689: ('0.12372611428830797',)} new output for save of step final : {1388238806: ('0.12372611428830797',), 1388238802: ('0.12372611428830797',), 1388238797: ('0.12372611428830797',), 1388238791: ('0.12372611428830797',), 1388238784: ('0.12372611428830797',), 1388238769: ('0.12372611428830797',), 1388238766: ('0.12372611428830797',), 1388238760: ('0.12372611428830797',), 1388238756: ('0.12372611428830797',), 1388238754: ('0.12372611428830797',), 1388238752: ('0.12372611428830797',), 1388238734: ('0.12372611428830797',), 1388238732: ('0.12372611428830797',), 1388238726: ('0.12372611428830797',), 1388238716: ('0.12372611428830797',), 1388238702: ('0.12372611428830797',), 1388238689: ('0.12372611428830797',)} [1388238806, 1388238802, 1388238797, 1388238791, 1388238784, 1388238769, 1388238766, 1388238760, 1388238756, 1388238754, 1388238752, 1388238734, 1388238732, 1388238726, 1388238716, 1388238702, 1388238689] Looping around the photos to save general results len do output : 17 /1388238806.Didn't retrieve data . /1388238802.Didn't retrieve data . /1388238797.Didn't retrieve data . /1388238791.Didn't retrieve data . /1388238784.Didn't retrieve data . /1388238769.Didn't retrieve data . /1388238766.Didn't retrieve data . /1388238760.Didn't retrieve data . /1388238756.Didn't retrieve data . /1388238754.Didn't retrieve data . /1388238752.Didn't retrieve data . /1388238734.Didn't retrieve data . /1388238732.Didn't retrieve data . /1388238726.Didn't retrieve data . /1388238716.Didn't retrieve data . /1388238702.Didn't retrieve data . /1388238689.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238806', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238802', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238797', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238791', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238784', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238769', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238766', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238760', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238756', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238754', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238752', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238734', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238732', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238726', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238716', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238702', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238689', None, None, None, None, None, '3903209') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 51 time used for this insertion : 0.036185503005981445 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.37700581550598145 time spend to save output : 0.03693366050720215 total time spend for step 5 : 0.4139394760131836 step6:blur_detection Thu Oct 9 12:21:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1760005231_2033379_1388238806_0b6d8ee7ea3fd8f22f11fc1e2bd3bca6.jpg resize: (1080, 1920) 1388238806 -2.3820364151354405 treat image : temp/1760005231_2033379_1388238802_3582e7ab11328d7470b4096c12291e42.jpg resize: (1080, 1920) 1388238802 -2.416811797540981 treat image : temp/1760005231_2033379_1388238797_041b2b5ab097e0373802a098a0c11ae4.jpg resize: (1080, 1920) 1388238797 -2.091117791538304 treat image : temp/1760005231_2033379_1388238791_c3af5a7e69cef6be5e0064eef1b0e18b.jpg resize: (1080, 1920) 1388238791 -2.1637679215072025 treat image : temp/1760005231_2033379_1388238784_83dcd2812a680cabbeb3621ce0e9b6ce.jpg resize: (1080, 1920) 1388238784 -1.896399451007921 treat image : temp/1760005231_2033379_1388238769_0cd43123d36bf8d36e9a85328cf155ab.jpg resize: (1080, 1920) 1388238769 -2.1648671233339947 treat image : temp/1760005231_2033379_1388238766_4e114885786830e39e74dbf28008b350.jpg resize: (1080, 1920) 1388238766 -1.9480635941607087 treat image : temp/1760005231_2033379_1388238760_0f64d9b3bf88ee40986484efe31c38d7.jpg resize: (1080, 1920) 1388238760 -1.805406830147252 treat image : temp/1760005231_2033379_1388238756_b809525949b3435b557bf6f69604e96d.jpg resize: (1080, 1920) 1388238756 -2.4968674317205437 treat image : temp/1760005231_2033379_1388238754_c11935f86c2493a496614c3c4317c9e8.jpg resize: (1080, 1920) 1388238754 -0.7085180702840554 treat image : temp/1760005231_2033379_1388238752_7764a0bf2aca0bd8c587a67abe502617.jpg resize: (1080, 1920) 1388238752 -1.9743192668578315 treat image : temp/1760005231_2033379_1388238734_3bc42ddac90e5aa965d61b57264f1911.jpg resize: (1080, 1920) 1388238734 -1.506703093755584 treat image : temp/1760005231_2033379_1388238732_921201c484a1c13e4a8991b75b4a140a.jpg resize: (1080, 1920) 1388238732 -1.164478401812785 treat image : temp/1760005231_2033379_1388238726_4936300469de14b0605f434b3ab92c6b.jpg resize: (1080, 1920) 1388238726 -1.5724239630960404 treat image : temp/1760005231_2033379_1388238716_c1e639966656cf71d5ad763ac684fab4.jpg resize: (1080, 1920) 1388238716 -2.880318438089434 treat image : temp/1760005231_2033379_1388238702_11014c67bcc22a2b4e5cd68faed2d327.jpg resize: (1080, 1920) 1388238702 -2.4635218279740747 treat image : temp/1760005231_2033379_1388238689_a75541df6835abfd1ae47f9699a45bc0.jpg resize: (1080, 1920) 1388238689 -1.7083233131243252 treat image : temp/1760005231_2033379_1388238802_3582e7ab11328d7470b4096c12291e42_rle_crop_3990401654_0.png resize: (172, 132) 1388386183 -2.32495288995109 treat image : temp/1760005231_2033379_1388238797_041b2b5ab097e0373802a098a0c11ae4_rle_crop_3990401658_0.png resize: (56, 32) 1388386184 20.0 treat image : temp/1760005231_2033379_1388238769_0cd43123d36bf8d36e9a85328cf155ab_rle_crop_3990401662_0.png resize: (34, 116) 1388386185 -1.110579906529536 treat image : temp/1760005231_2033379_1388238766_4e114885786830e39e74dbf28008b350_rle_crop_3990401664_0.png resize: (77, 78) 1388386186 -1.5003915477924976 treat image : temp/1760005231_2033379_1388238760_0f64d9b3bf88ee40986484efe31c38d7_rle_crop_3990401666_0.png resize: (91, 82) 1388386187 -1.4752481188164697 treat image : temp/1760005231_2033379_1388238734_3bc42ddac90e5aa965d61b57264f1911_rle_crop_3990401673_0.png resize: (88, 114) 1388386188 1.97734695675123 treat image : temp/1760005231_2033379_1388238756_b809525949b3435b557bf6f69604e96d_rle_crop_3990401668_0.png resize: (100, 85) 1388386191 -2.057286632992865 treat image : temp/1760005231_2033379_1388238756_b809525949b3435b557bf6f69604e96d_rle_crop_3990401669_0.png resize: (142, 87) 1388386192 -1.3078664797932746 treat image : temp/1760005231_2033379_1388238754_c11935f86c2493a496614c3c4317c9e8_rle_crop_3990401670_0.png resize: (123, 121) 1388386193 -1.5595857614770563 treat image : temp/1760005231_2033379_1388238734_3bc42ddac90e5aa965d61b57264f1911_rle_crop_3990401675_0.png resize: (96, 151) 1388386194 -1.7398158475157068 treat image : temp/1760005231_2033379_1388238726_4936300469de14b0605f434b3ab92c6b_rle_crop_3990401680_0.png resize: (85, 100) 1388386195 0.11109369522121527 treat image : temp/1760005231_2033379_1388238702_11014c67bcc22a2b4e5cd68faed2d327_rle_crop_3990401684_0.png resize: (87, 83) 1388386196 -1.8295665387368956 treat image : temp/1760005231_2033379_1388238726_4936300469de14b0605f434b3ab92c6b_rle_crop_3990401678_0.png resize: (111, 83) 1388386197 -2.5007917704117766 treat image : temp/1760005231_2033379_1388238726_4936300469de14b0605f434b3ab92c6b_rle_crop_3990401679_0.png resize: (97, 150) 1388386198 -2.3973335904938784 treat image : temp/1760005231_2033379_1388238716_c1e639966656cf71d5ad763ac684fab4_rle_crop_3990401683_0.png resize: (83, 63) 1388386199 -1.2808243763306737 treat image : temp/1760005231_2033379_1388238806_0b6d8ee7ea3fd8f22f11fc1e2bd3bca6_rle_crop_3990401652_0.png resize: (259, 259) 1388386602 -2.7200518029140213 treat image : temp/1760005231_2033379_1388238802_3582e7ab11328d7470b4096c12291e42_rle_crop_3990401655_0.png resize: (55, 82) 1388386616 -1.7646088652379617 treat image : temp/1760005231_2033379_1388238797_041b2b5ab097e0373802a098a0c11ae4_rle_crop_3990401657_0.png resize: (1007, 1607) 1388386629 -2.2208132813568993 treat image : temp/1760005231_2033379_1388238797_041b2b5ab097e0373802a098a0c11ae4_rle_crop_3990401656_0.png resize: (505, 358) 1388386643 -0.024421898162050933 treat image : temp/1760005231_2033379_1388238784_83dcd2812a680cabbeb3621ce0e9b6ce_rle_crop_3990401659_0.png resize: (64, 69) 1388386657 -1.9013970498665087 treat image : temp/1760005231_2033379_1388238784_83dcd2812a680cabbeb3621ce0e9b6ce_rle_crop_3990401661_0.png resize: (109, 65) 1388386670 -1.0486402071178538 treat image : temp/1760005231_2033379_1388238784_83dcd2812a680cabbeb3621ce0e9b6ce_rle_crop_3990401660_0.png resize: (361, 215) 1388386682 -1.3736601762962068 treat image : temp/1760005231_2033379_1388238766_4e114885786830e39e74dbf28008b350_rle_crop_3990401663_0.png resize: (980, 1105) 1388386683 0.006616068891835027 treat image : temp/1760005231_2033379_1388238760_0f64d9b3bf88ee40986484efe31c38d7_rle_crop_3990401667_0.png resize: (46, 216) 1388386684 -4.186141180482425 treat image : temp/1760005231_2033379_1388238760_0f64d9b3bf88ee40986484efe31c38d7_rle_crop_3990401665_0.png resize: (552, 376) 1388386686 -0.4901332683113802 treat image : temp/1760005231_2033379_1388238754_c11935f86c2493a496614c3c4317c9e8_rle_crop_3990401671_0.png resize: (972, 980) 1388386687 0.5710973480599879 treat image : temp/1760005231_2033379_1388238752_7764a0bf2aca0bd8c587a67abe502617_rle_crop_3990401672_0.png resize: (939, 1017) 1388386689 0.15409280092604086 treat image : temp/1760005231_2033379_1388238734_3bc42ddac90e5aa965d61b57264f1911_rle_crop_3990401674_0.png resize: (97, 99) 1388386690 0.31530022730305846 treat image : temp/1760005231_2033379_1388238732_921201c484a1c13e4a8991b75b4a140a_rle_crop_3990401676_0.png resize: (117, 169) 1388386691 -2.3454142211852185 treat image : temp/1760005231_2033379_1388238732_921201c484a1c13e4a8991b75b4a140a_rle_crop_3990401677_0.png resize: (526, 358) 1388386692 -0.09320983339426664 treat image : temp/1760005231_2033379_1388238726_4936300469de14b0605f434b3ab92c6b_rle_crop_3990401681_0.png resize: (523, 338) 1388386693 -0.8608362364928789 treat image : temp/1760005231_2033379_1388238702_11014c67bcc22a2b4e5cd68faed2d327_rle_crop_3990401685_0.png resize: (201, 135) 1388386694 -3.485181315577698 treat image : temp/1760005231_2033379_1388238802_3582e7ab11328d7470b4096c12291e42_rle_crop_3990401653_0.png resize: (51, 52) 1388386772 0.6104003738267971 treat image : temp/1760005231_2033379_1388238716_c1e639966656cf71d5ad763ac684fab4_rle_crop_3990401682_0.png resize: (130, 44) 1388386773 -1.984545831977622 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 51 time used for this insertion : 0.04360485076904297 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 51 time used for this insertion : 0.036048173904418945 save missing photos in datou_result : time spend for datou_step_exec : 15.33744215965271 time spend to save output : 0.09724640846252441 total time spend for step 6 : 15.434688568115234 step7:brightness Thu Oct 9 12:22:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1760005231_2033379_1388238806_0b6d8ee7ea3fd8f22f11fc1e2bd3bca6.jpg treat image : temp/1760005231_2033379_1388238802_3582e7ab11328d7470b4096c12291e42.jpg treat image : temp/1760005231_2033379_1388238797_041b2b5ab097e0373802a098a0c11ae4.jpg treat image : temp/1760005231_2033379_1388238791_c3af5a7e69cef6be5e0064eef1b0e18b.jpg treat image : temp/1760005231_2033379_1388238784_83dcd2812a680cabbeb3621ce0e9b6ce.jpg treat image : temp/1760005231_2033379_1388238769_0cd43123d36bf8d36e9a85328cf155ab.jpg treat image : temp/1760005231_2033379_1388238766_4e114885786830e39e74dbf28008b350.jpg treat image : temp/1760005231_2033379_1388238760_0f64d9b3bf88ee40986484efe31c38d7.jpg treat image : temp/1760005231_2033379_1388238756_b809525949b3435b557bf6f69604e96d.jpg treat image : temp/1760005231_2033379_1388238754_c11935f86c2493a496614c3c4317c9e8.jpg treat image : temp/1760005231_2033379_1388238752_7764a0bf2aca0bd8c587a67abe502617.jpg treat image : temp/1760005231_2033379_1388238734_3bc42ddac90e5aa965d61b57264f1911.jpg treat image : temp/1760005231_2033379_1388238732_921201c484a1c13e4a8991b75b4a140a.jpg treat image : temp/1760005231_2033379_1388238726_4936300469de14b0605f434b3ab92c6b.jpg treat image : temp/1760005231_2033379_1388238716_c1e639966656cf71d5ad763ac684fab4.jpg treat image : temp/1760005231_2033379_1388238702_11014c67bcc22a2b4e5cd68faed2d327.jpg treat image : temp/1760005231_2033379_1388238689_a75541df6835abfd1ae47f9699a45bc0.jpg treat image : temp/1760005231_2033379_1388238802_3582e7ab11328d7470b4096c12291e42_rle_crop_3990401654_0.png treat image : temp/1760005231_2033379_1388238797_041b2b5ab097e0373802a098a0c11ae4_rle_crop_3990401658_0.png treat image : temp/1760005231_2033379_1388238769_0cd43123d36bf8d36e9a85328cf155ab_rle_crop_3990401662_0.png treat image : temp/1760005231_2033379_1388238766_4e114885786830e39e74dbf28008b350_rle_crop_3990401664_0.png treat image : temp/1760005231_2033379_1388238760_0f64d9b3bf88ee40986484efe31c38d7_rle_crop_3990401666_0.png treat image : temp/1760005231_2033379_1388238734_3bc42ddac90e5aa965d61b57264f1911_rle_crop_3990401673_0.png treat image : temp/1760005231_2033379_1388238756_b809525949b3435b557bf6f69604e96d_rle_crop_3990401668_0.png treat image : temp/1760005231_2033379_1388238756_b809525949b3435b557bf6f69604e96d_rle_crop_3990401669_0.png treat image : temp/1760005231_2033379_1388238754_c11935f86c2493a496614c3c4317c9e8_rle_crop_3990401670_0.png treat image : temp/1760005231_2033379_1388238734_3bc42ddac90e5aa965d61b57264f1911_rle_crop_3990401675_0.png treat image : temp/1760005231_2033379_1388238726_4936300469de14b0605f434b3ab92c6b_rle_crop_3990401680_0.png treat image : temp/1760005231_2033379_1388238702_11014c67bcc22a2b4e5cd68faed2d327_rle_crop_3990401684_0.png treat image : temp/1760005231_2033379_1388238726_4936300469de14b0605f434b3ab92c6b_rle_crop_3990401678_0.png treat image : temp/1760005231_2033379_1388238726_4936300469de14b0605f434b3ab92c6b_rle_crop_3990401679_0.png treat image : temp/1760005231_2033379_1388238716_c1e639966656cf71d5ad763ac684fab4_rle_crop_3990401683_0.png treat image : temp/1760005231_2033379_1388238806_0b6d8ee7ea3fd8f22f11fc1e2bd3bca6_rle_crop_3990401652_0.png treat image : temp/1760005231_2033379_1388238802_3582e7ab11328d7470b4096c12291e42_rle_crop_3990401655_0.png treat image : temp/1760005231_2033379_1388238797_041b2b5ab097e0373802a098a0c11ae4_rle_crop_3990401657_0.png treat image : temp/1760005231_2033379_1388238797_041b2b5ab097e0373802a098a0c11ae4_rle_crop_3990401656_0.png treat image : temp/1760005231_2033379_1388238784_83dcd2812a680cabbeb3621ce0e9b6ce_rle_crop_3990401659_0.png treat image : temp/1760005231_2033379_1388238784_83dcd2812a680cabbeb3621ce0e9b6ce_rle_crop_3990401661_0.png treat image : temp/1760005231_2033379_1388238784_83dcd2812a680cabbeb3621ce0e9b6ce_rle_crop_3990401660_0.png treat image : temp/1760005231_2033379_1388238766_4e114885786830e39e74dbf28008b350_rle_crop_3990401663_0.png treat image : temp/1760005231_2033379_1388238760_0f64d9b3bf88ee40986484efe31c38d7_rle_crop_3990401667_0.png treat image : temp/1760005231_2033379_1388238760_0f64d9b3bf88ee40986484efe31c38d7_rle_crop_3990401665_0.png treat image : temp/1760005231_2033379_1388238754_c11935f86c2493a496614c3c4317c9e8_rle_crop_3990401671_0.png treat image : temp/1760005231_2033379_1388238752_7764a0bf2aca0bd8c587a67abe502617_rle_crop_3990401672_0.png treat image : temp/1760005231_2033379_1388238734_3bc42ddac90e5aa965d61b57264f1911_rle_crop_3990401674_0.png treat image : temp/1760005231_2033379_1388238732_921201c484a1c13e4a8991b75b4a140a_rle_crop_3990401676_0.png treat image : temp/1760005231_2033379_1388238732_921201c484a1c13e4a8991b75b4a140a_rle_crop_3990401677_0.png treat image : temp/1760005231_2033379_1388238726_4936300469de14b0605f434b3ab92c6b_rle_crop_3990401681_0.png treat image : temp/1760005231_2033379_1388238702_11014c67bcc22a2b4e5cd68faed2d327_rle_crop_3990401685_0.png treat image : temp/1760005231_2033379_1388238802_3582e7ab11328d7470b4096c12291e42_rle_crop_3990401653_0.png treat image : temp/1760005231_2033379_1388238716_c1e639966656cf71d5ad763ac684fab4_rle_crop_3990401682_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 51 time used for this insertion : 0.03962874412536621 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 51 time used for this insertion : 0.036656856536865234 save missing photos in datou_result : time spend for datou_step_exec : 4.41893196105957 time spend to save output : 0.09348678588867188 total time spend for step 7 : 4.512418746948242 step8:velours_tree Thu Oct 9 12:22:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.13850855827331543 time spend to save output : 3.5762786865234375e-05 total time spend for step 8 : 0.13854432106018066 step9:send_mail_cod Thu Oct 9 12:22:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P27641624_09-10-2025_12_22_12.pdf 27642323 imagette276423231760005332 27642324 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette276423241760005332 27642325 imagette276423251760005333 27642327 imagette276423271760005333 27642328 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette276423281760005333 27642329 change filename to text .change filename to text .change filename to text .imagette276423291760005335 27642330 imagette276423301760005335 27642331 imagette276423311760005335 27642332 change filename to text .change filename to text .imagette276423321760005335 27642333 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette276423331760005335 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27641624 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27642323,27642324,27642325,27642326,27642327,27642328,27642329,27642330,27642331,27642332,27642333?tags=flou,carton,pehd,environnement,mal_croppe,pet_clair,metal,background,pet_fonce,autre,papier args[1388238806] : ((1388238806, -2.3820364151354405, 492609224), (1388238806, 0.5215618665698851, 2107752395), '0.12372611428830797') We are sending mail with results at report@fotonower.com args[1388238802] : ((1388238802, -2.416811797540981, 492609224), (1388238802, 0.5007458245204799, 2107752395), '0.12372611428830797') We are sending mail with results at report@fotonower.com args[1388238797] : ((1388238797, -2.091117791538304, 492609224), (1388238797, 0.49770006676539935, 2107752395), '0.12372611428830797') We are sending mail with results at report@fotonower.com args[1388238791] : ((1388238791, -2.1637679215072025, 492609224), (1388238791, 0.6522887920256758, 2107752395), '0.12372611428830797') We are sending mail with results at report@fotonower.com args[1388238784] : ((1388238784, -1.896399451007921, 492688767), (1388238784, 0.4662416301334923, 2107752395), '0.12372611428830797') We are sending mail with results at report@fotonower.com args[1388238769] : ((1388238769, -2.1648671233339947, 492609224), (1388238769, 0.6774056121834938, 2107752395), '0.12372611428830797') We are sending mail with results at report@fotonower.com args[1388238766] : ((1388238766, -1.9480635941607087, 492688767), (1388238766, 0.5964626133553053, 2107752395), '0.12372611428830797') We are sending mail with results at report@fotonower.com args[1388238760] : ((1388238760, -1.805406830147252, 492688767), (1388238760, 0.3900849753601279, 2107752395), '0.12372611428830797') We are sending mail with results at report@fotonower.com args[1388238756] : ((1388238756, -2.4968674317205437, 492609224), (1388238756, 0.585545896008408, 2107752395), '0.12372611428830797') We are sending mail with results at report@fotonower.com args[1388238754] : ((1388238754, -0.7085180702840554, 492688767), (1388238754, 0.5228527028406686, 2107752395), '0.12372611428830797') We are sending mail with results at report@fotonower.com args[1388238752] : ((1388238752, -1.9743192668578315, 492688767), (1388238752, 0.4597213255397384, 2107752395), '0.12372611428830797') We are sending mail with results at report@fotonower.com args[1388238734] : ((1388238734, -1.506703093755584, 492688767), (1388238734, 0.7344086293680796, 2107752395), '0.12372611428830797') We are sending mail with results at report@fotonower.com args[1388238732] : ((1388238732, -1.164478401812785, 492688767), (1388238732, 0.3006564242788327, 2107752395), '0.12372611428830797') We are sending mail with results at report@fotonower.com args[1388238726] : ((1388238726, -1.5724239630960404, 492688767), (1388238726, 0.2176434279324955, 2107752395), '0.12372611428830797') We are sending mail with results at report@fotonower.com args[1388238716] : ((1388238716, -2.880318438089434, 492609224), (1388238716, 0.4715131380475982, 2107752395), '0.12372611428830797') We are sending mail with results at report@fotonower.com args[1388238702] : ((1388238702, -2.4635218279740747, 492609224), (1388238702, 0.5026032300495649, 2107752395), '0.12372611428830797') We are sending mail with results at report@fotonower.com args[1388238689] : ((1388238689, -1.7083233131243252, 492688767), (1388238689, 0.590110804826446, 2107752395), '0.12372611428830797') We are sending mail with results at report@fotonower.com refus_total : 0.12372611428830797 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27641624 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27641624_09-10-2025_12_22_12.pdf results_Auto_P27641624_09-10-2025_12_22_12.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27641624_09-10-2025_12_22_12.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','27641624','results_Auto_P27641624_09-10-2025_12_22_12.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27641624_09-10-2025_12_22_12.pdf','pdf','','0.56','0.12372611428830797') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/27641624

https://www.fotonower.com/image?json=false&list_photos_id=1388238806
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388238802
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388238797
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388238791
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388238784
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388238769
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388238766
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388238760
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388238756
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388238754
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388238752
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388238734
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388238732
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388238726
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388238716
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388238702
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1388238689
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 12.37%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/27642324?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/27642328?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/27642329?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/27642332?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/27642333?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27641624_09-10-2025_12_22_12.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/27642323,27642324,27642325,27642326,27642327,27642328,27642329,27642330,27642331,27642332,27642333?tags=flou,carton,pehd,environnement,mal_croppe,pet_clair,metal,background,pet_fonce,autre,papier.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 09 Oct 2025 10:22:18 GMT Content-Length: 0 Connection: close X-Message-Id: WfNBkbseTVS-La3Mg9IcLw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1388238806, 1388238802, 1388238797, 1388238791, 1388238784, 1388238769, 1388238766, 1388238760, 1388238756, 1388238754, 1388238752, 1388238734, 1388238732, 1388238726, 1388238716, 1388238702, 1388238689] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238806', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238802', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238797', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238791', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238784', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238769', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238766', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238760', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238756', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238754', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238752', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238734', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238732', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238726', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238716', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238702', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238689', None, None, None, None, None, '3903209') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 17 time used for this insertion : 0.04734921455383301 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.2523839473724365 time spend to save output : 0.04758501052856445 total time spend for step 9 : 6.299968957901001 step10:split_time_score Thu Oct 9 12:22:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 17),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 08102025 27641624 Nombre de photos uploadées : 17 / 23040 (0%) 08102025 27641624 Nombre de photos taguées (types de déchets): 0 / 17 (0%) 08102025 27641624 Nombre de photos taguées (volume) : 0 / 17 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 7.152557373046875e-06 ????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0008208751678466797 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.6342430114746094 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.20286307629243827 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27592179_08-10-2025_13_21_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27592179 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27592179 AND mptpi.`type`=3594 To do Qualite : 0.03041503906250001 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27592183_08-10-2025_13_03_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27592183 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27592183 AND mptpi.`type`=3594 To do Qualite : 0.253427533436214 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27592186_08-10-2025_13_12_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27592186 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27592186 AND mptpi.`type`=3594 To do Qualite : 0.09278805347815768 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27592214_08-10-2025_12_42_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27592214 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27592214 AND mptpi.`type`=3594 To do Qualite : 0.030465505751964085 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27592223_08-10-2025_12_31_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27592223 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27592223 AND mptpi.`type`=3594 To do Qualite : 0.13276063924501427 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27592225_08-10-2025_12_22_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27592225 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27592225 AND mptpi.`type`=3594 To do Qualite : 0.07691526813271601 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27592231_08-10-2025_12_13_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27592231 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27592231 AND mptpi.`type`=3594 To do Qualite : 0.02488828749092229 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27600762_08-10-2025_15_11_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27600762 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27600762 AND mptpi.`type`=3594 To do Qualite : 0.12372611428830797 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27641624_09-10-2025_12_22_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27641624 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27641624 AND mptpi.`type`=3594 To do Qualite : 0.026468423551756885 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27641629_09-10-2025_12_11_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27641629 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27641629 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'08102025': {'nb_upload': 17, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1388238806, 1388238802, 1388238797, 1388238791, 1388238784, 1388238769, 1388238766, 1388238760, 1388238756, 1388238754, 1388238752, 1388238734, 1388238732, 1388238726, 1388238716, 1388238702, 1388238689] Looping around the photos to save general results len do output : 1 /27641624Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238806', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238802', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238797', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238791', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238784', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238769', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238766', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238760', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238756', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238754', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238752', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238734', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238732', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238726', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238716', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238702', None, None, None, None, None, '3903209') ('3318', None, None, None, None, None, None, None, '3903209') ('3318', '27641624', '1388238689', None, None, None, None, None, '3903209') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.039553165435791016 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.2735531330108643 time spend to save output : 0.03979325294494629 total time spend for step 10 : 3.3133463859558105 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 17 set_done_treatment 58.65user 21.32system 1:55.94elapsed 68%CPU (0avgtext+0avgdata 2720352maxresident)k 262328inputs+39152outputs (51major+1357575minor)pagefaults 0swaps