python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1442619 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3555593'] with mtr_portfolio_ids : ['26072156'] and first list_photo_ids : [] new path : /proc/1442619/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 12 ; length of list_pids : 12 ; length of list_args : 12 time to download the photos : 1.8235933780670166 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Aug 20 09:40:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10393 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-20 09:40:33.242542: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-20 09:40:33.268693: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-20 09:40:33.270418: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fc3a8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-20 09:40:33.270473: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-20 09:40:33.273261: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-20 09:40:33.388971: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x268d6370 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-20 09:40:33.389011: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-20 09:40:33.389927: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-20 09:40:33.390227: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-20 09:40:33.392436: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-20 09:40:33.394602: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-20 09:40:33.394924: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-20 09:40:33.397240: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-20 09:40:33.398413: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-20 09:40:33.403643: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-20 09:40:33.405199: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-20 09:40:33.405281: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-20 09:40:33.406063: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-20 09:40:33.406080: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-20 09:40:33.406089: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-20 09:40:33.407463: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9483 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-20 09:40:33.746300: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-20 09:40:33.746430: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-20 09:40:33.746451: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-20 09:40:33.746470: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-20 09:40:33.746486: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-20 09:40:33.746507: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-20 09:40:33.746527: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-20 09:40:33.746547: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-20 09:40:33.747761: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-20 09:40:33.749919: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-20 09:40:33.749990: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-20 09:40:33.750023: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-20 09:40:33.750061: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-20 09:40:33.750101: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-20 09:40:33.750138: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-20 09:40:33.750177: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-20 09:40:33.750206: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-20 09:40:33.752621: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-20 09:40:33.752698: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-20 09:40:33.752719: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-20 09:40:33.752736: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-20 09:40:33.755102: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9483 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-20 09:40:42.425901: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-20 09:40:42.633445: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 1443111 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 528 tf kernel not reseted sub process len(results) : 12 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 12 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5425 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00030040740966796875 nb_pixel_total : 6634 time to create 1 rle with old method : 0.007769346237182617 length of segment : 164 time for calcul the mask position with numpy : 0.00037097930908203125 nb_pixel_total : 10249 time to create 1 rle with old method : 0.016304969787597656 length of segment : 176 time for calcul the mask position with numpy : 0.00024890899658203125 nb_pixel_total : 5703 time to create 1 rle with old method : 0.008742094039916992 length of segment : 74 time for calcul the mask position with numpy : 0.015445709228515625 nb_pixel_total : 697417 time to create 1 rle with new method : 0.05689358711242676 length of segment : 942 time for calcul the mask position with numpy : 0.00039958953857421875 nb_pixel_total : 19478 time to create 1 rle with old method : 0.023268938064575195 length of segment : 178 time for calcul the mask position with numpy : 0.0007884502410888672 nb_pixel_total : 45573 time to create 1 rle with old method : 0.05413699150085449 length of segment : 157 time for calcul the mask position with numpy : 0.00030422210693359375 nb_pixel_total : 17454 time to create 1 rle with old method : 0.021239519119262695 length of segment : 159 time for calcul the mask position with numpy : 0.01577019691467285 nb_pixel_total : 740828 time to create 1 rle with new method : 0.044821977615356445 length of segment : 952 time for calcul the mask position with numpy : 0.015031814575195312 nb_pixel_total : 763894 time to create 1 rle with new method : 0.025928258895874023 length of segment : 963 time for calcul the mask position with numpy : 0.0003192424774169922 nb_pixel_total : 13614 time to create 1 rle with old method : 0.015889644622802734 length of segment : 154 time for calcul the mask position with numpy : 0.00023794174194335938 nb_pixel_total : 11033 time to create 1 rle with old method : 0.01248788833618164 length of segment : 185 time for calcul the mask position with numpy : 0.018281936645507812 nb_pixel_total : 1165374 time to create 1 rle with new method : 0.1265430450439453 length of segment : 1581 time for calcul the mask position with numpy : 0.00041747093200683594 nb_pixel_total : 7823 time to create 1 rle with old method : 0.009175300598144531 length of segment : 102 time for calcul the mask position with numpy : 0.000728607177734375 nb_pixel_total : 23194 time to create 1 rle with old method : 0.027300357818603516 length of segment : 166 time for calcul the mask position with numpy : 0.0006425380706787109 nb_pixel_total : 12368 time to create 1 rle with old method : 0.014614105224609375 length of segment : 188 time for calcul the mask position with numpy : 0.003730297088623047 nb_pixel_total : 104579 time to create 1 rle with old method : 0.11898398399353027 length of segment : 559 time for calcul the mask position with numpy : 0.002605438232421875 nb_pixel_total : 103302 time to create 1 rle with old method : 0.11766409873962402 length of segment : 521 time for calcul the mask position with numpy : 0.0003943443298339844 nb_pixel_total : 10865 time to create 1 rle with old method : 0.013061761856079102 length of segment : 134 time for calcul the mask position with numpy : 0.0017919540405273438 nb_pixel_total : 107904 time to create 1 rle with old method : 0.12433385848999023 length of segment : 558 time for calcul the mask position with numpy : 0.0002315044403076172 nb_pixel_total : 8119 time to create 1 rle with old method : 0.009619712829589844 length of segment : 121 time for calcul the mask position with numpy : 0.00010085105895996094 nb_pixel_total : 3000 time to create 1 rle with old method : 0.0036928653717041016 length of segment : 71 time for calcul the mask position with numpy : 0.00021886825561523438 nb_pixel_total : 12907 time to create 1 rle with old method : 0.015297412872314453 length of segment : 127 time for calcul the mask position with numpy : 0.00047707557678222656 nb_pixel_total : 10186 time to create 1 rle with old method : 0.011743545532226562 length of segment : 173 time for calcul the mask position with numpy : 0.00017642974853515625 nb_pixel_total : 2578 time to create 1 rle with old method : 0.0033426284790039062 length of segment : 40 time spent for convertir_results : 2.7928144931793213 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 24 chid ids of type : 3594 Number RLEs to save : 8445 save missing photos in datou_result : time spend for datou_step_exec : 26.762980937957764 time spend to save output : 0.761981725692749 total time spend for step 1 : 27.524962663650513 step2:crop_condition Wed Aug 20 09:40:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 12 ! batch 1 Loaded 24 chid ids of type : 3594 ++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755675658_1442619 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.346235752105713 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755675662_1442619 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0739128589630127 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3736932 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755675678_1442619 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 12 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.9616289138793945 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755675682_1442619 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8279225826263428 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1377890634, 1377890629, 1377890626, 1377890595, 1377890594, 1377890593, 1377890592, 1377890588, 1377890585, 1377890573, 1377890568, 1377890566] Looping around the photos to save general results len do output : 24 /1377994697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377994734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890634', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890629', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890626', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890595', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890594', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890593', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890592', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890588', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890585', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890573', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890568', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890566', None, None, None, None, None, '3555593') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 84 time used for this insertion : 0.0306398868560791 save_final save missing photos in datou_result : time spend for datou_step_exec : 24.77337670326233 time spend to save output : 0.031540870666503906 total time spend for step 2 : 24.804917573928833 step3:rle_unique_nms_with_priority Wed Aug 20 09:41:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 24 chid ids of type : 3594 ++++++++++++++++++++++++++++nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.16798758506774902 time for calcul the mask position with numpy : 0.06472015380859375 nb_pixel_total : 2051014 time to create 1 rle with new method : 0.08801984786987305 time for calcul the mask position with numpy : 0.006428718566894531 nb_pixel_total : 5703 time to create 1 rle with old method : 0.00647425651550293 time for calcul the mask position with numpy : 0.0073206424713134766 nb_pixel_total : 10249 time to create 1 rle with old method : 0.011496305465698242 time for calcul the mask position with numpy : 0.006676673889160156 nb_pixel_total : 6634 time to create 1 rle with old method : 0.007365226745605469 create new chi : 0.21046853065490723 time to delete rle : 0.025247812271118164 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1908 TO DO : save crop sub photo not yet done ! save time : 0.2468099594116211 No data in photo_id : 1377890629 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.16108322143554688 time for calcul the mask position with numpy : 0.3235771656036377 nb_pixel_total : 1311132 time to create 1 rle with new method : 0.08585453033447266 time for calcul the mask position with numpy : 0.006864070892333984 nb_pixel_total : 45573 time to create 1 rle with old method : 0.056699514389038086 time for calcul the mask position with numpy : 0.007111072540283203 nb_pixel_total : 19478 time to create 1 rle with old method : 0.024422645568847656 time for calcul the mask position with numpy : 0.014790534973144531 nb_pixel_total : 697417 time to create 1 rle with new method : 0.0780935287475586 create new chi : 0.6172714233398438 time to delete rle : 0.0007262229919433594 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3634 TO DO : save crop sub photo not yet done ! save time : 0.3411836624145508 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.06729674339294434 time for calcul the mask position with numpy : 0.05274629592895508 nb_pixel_total : 1315318 time to create 1 rle with new method : 0.5985927581787109 time for calcul the mask position with numpy : 0.014291524887084961 nb_pixel_total : 740828 time to create 1 rle with new method : 0.36638593673706055 time for calcul the mask position with numpy : 0.006827592849731445 nb_pixel_total : 17454 time to create 1 rle with old method : 0.020294904708862305 create new chi : 1.0691049098968506 time to delete rle : 0.0005176067352294922 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3302 TO DO : save crop sub photo not yet done ! save time : 0.30910348892211914 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04678988456726074 time for calcul the mask position with numpy : 0.04832577705383301 nb_pixel_total : 1309706 time to create 1 rle with new method : 0.10559797286987305 time for calcul the mask position with numpy : 0.012419462203979492 nb_pixel_total : 763894 time to create 1 rle with new method : 0.07720780372619629 create new chi : 0.25410032272338867 time to delete rle : 0.0002677440643310547 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 3006 TO DO : save crop sub photo not yet done ! save time : 0.2782769203186035 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.9261302947998047 time for calcul the mask position with numpy : 0.027573823928833008 nb_pixel_total : 883954 time to create 1 rle with new method : 0.27695131301879883 time for calcul the mask position with numpy : 0.03957533836364746 nb_pixel_total : 1164999 time to create 1 rle with new method : 0.0824422836303711 time for calcul the mask position with numpy : 0.007193088531494141 nb_pixel_total : 11033 time to create 1 rle with old method : 0.017728567123413086 time for calcul the mask position with numpy : 0.007016420364379883 nb_pixel_total : 13614 time to create 1 rle with old method : 0.022161245346069336 create new chi : 0.501366138458252 time to delete rle : 0.00084686279296875 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 4852 TO DO : save crop sub photo not yet done ! save time : 0.42293715476989746 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03769993782043457 time for calcul the mask position with numpy : 0.023633956909179688 nb_pixel_total : 2065777 time to create 1 rle with new method : 0.2597463130950928 time for calcul the mask position with numpy : 0.00687098503112793 nb_pixel_total : 7823 time to create 1 rle with old method : 0.008882999420166016 create new chi : 0.30652666091918945 time to delete rle : 0.0002243518829345703 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1284 TO DO : save crop sub photo not yet done ! save time : 0.19095134735107422 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.1493663787841797 time for calcul the mask position with numpy : 0.2707552909851074 nb_pixel_total : 2050406 time to create 1 rle with new method : 0.28325700759887695 time for calcul the mask position with numpy : 0.006460666656494141 nb_pixel_total : 23194 time to create 1 rle with old method : 0.02619767189025879 create new chi : 0.5973169803619385 time to delete rle : 0.0002868175506591797 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1412 TO DO : save crop sub photo not yet done ! save time : 0.12630438804626465 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.35187220573425293 time for calcul the mask position with numpy : 0.26343250274658203 nb_pixel_total : 1956653 time to create 1 rle with new method : 0.32436656951904297 time for calcul the mask position with numpy : 0.0075418949127197266 nb_pixel_total : 104579 time to create 1 rle with old method : 0.12827515602111816 time for calcul the mask position with numpy : 0.009489774703979492 nb_pixel_total : 12368 time to create 1 rle with old method : 0.02134990692138672 create new chi : 0.7657878398895264 time to delete rle : 0.0005762577056884766 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 2574 TO DO : save crop sub photo not yet done ! save time : 0.21300840377807617 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.13421940803527832 time for calcul the mask position with numpy : 0.5600559711456299 nb_pixel_total : 1950765 time to create 1 rle with new method : 0.297971248626709 time for calcul the mask position with numpy : 0.006194353103637695 nb_pixel_total : 8668 time to create 1 rle with old method : 0.009728193283081055 time for calcul the mask position with numpy : 0.006416797637939453 nb_pixel_total : 10865 time to create 1 rle with old method : 0.011553049087524414 time for calcul the mask position with numpy : 0.006598234176635742 nb_pixel_total : 103302 time to create 1 rle with old method : 0.11117172241210938 create new chi : 1.0223290920257568 time to delete rle : 0.0003361701965332031 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 2974 TO DO : save crop sub photo not yet done ! save time : 0.23321795463562012 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.04888272285461426 time for calcul the mask position with numpy : 0.1886610984802246 nb_pixel_total : 2049574 time to create 1 rle with new method : 0.38189268112182617 time for calcul the mask position with numpy : 0.006346702575683594 nb_pixel_total : 12907 time to create 1 rle with old method : 0.014366388320922852 time for calcul the mask position with numpy : 0.006220817565917969 nb_pixel_total : 3000 time to create 1 rle with old method : 0.003331899642944336 time for calcul the mask position with numpy : 0.006312847137451172 nb_pixel_total : 8119 time to create 1 rle with old method : 0.008997678756713867 create new chi : 0.6272640228271484 time to delete rle : 0.0003476142883300781 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1718 TO DO : save crop sub photo not yet done ! save time : 0.2078251838684082 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04332137107849121 time for calcul the mask position with numpy : 0.11319160461425781 nb_pixel_total : 2060836 time to create 1 rle with new method : 0.2703402042388916 time for calcul the mask position with numpy : 0.005965232849121094 nb_pixel_total : 2578 time to create 1 rle with old method : 0.0028162002563476562 time for calcul the mask position with numpy : 0.006860971450805664 nb_pixel_total : 10186 time to create 1 rle with old method : 0.011266708374023438 create new chi : 0.4142787456512451 time to delete rle : 0.0002646446228027344 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1506 TO DO : save crop sub photo not yet done ! save time : 0.15001177787780762 map_output_result : {1377890634: (0.0, 'Should be the crop_list due to order', 0), 1377890629: (0.0, 'Should be the crop_list due to order', 0.0), 1377890626: (0.0, 'Should be the crop_list due to order', 0), 1377890595: (0.0, 'Should be the crop_list due to order', 0), 1377890594: (0.0, 'Should be the crop_list due to order', 0), 1377890593: (0.0, 'Should be the crop_list due to order', 0), 1377890592: (0.0, 'Should be the crop_list due to order', 0), 1377890588: (0.0, 'Should be the crop_list due to order', 0), 1377890585: (0.0, 'Should be the crop_list due to order', 0), 1377890573: (0.0, 'Should be the crop_list due to order', 0), 1377890568: (0.0, 'Should be the crop_list due to order', 0), 1377890566: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1377890634, 1377890629, 1377890626, 1377890595, 1377890594, 1377890593, 1377890592, 1377890588, 1377890585, 1377890573, 1377890568, 1377890566] Looping around the photos to save general results len do output : 12 /1377890634.Didn't retrieve data . /1377890629.Didn't retrieve data . /1377890626.Didn't retrieve data . /1377890595.Didn't retrieve data . /1377890594.Didn't retrieve data . /1377890593.Didn't retrieve data . /1377890592.Didn't retrieve data . /1377890588.Didn't retrieve data . /1377890585.Didn't retrieve data . /1377890573.Didn't retrieve data . /1377890568.Didn't retrieve data . /1377890566.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890634', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890629', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890626', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890595', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890594', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890593', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890592', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890588', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890585', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890573', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890568', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890566', None, None, None, None, None, '3555593') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.030843496322631836 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.10955262184143 time spend to save output : 0.03130507469177246 total time spend for step 3 : 12.140857696533203 step4:ventilate_hashtags_in_portfolio Wed Aug 20 09:41:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26072156 get user id for portfolio 26072156 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26072156 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','flou','pet_clair','environnement','autre','mal_croppe','pehd','background','papier','carton','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26072156 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','flou','pet_clair','environnement','autre','mal_croppe','pehd','background','papier','carton','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26072156 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','flou','pet_clair','environnement','autre','mal_croppe','pehd','background','papier','carton','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/26072709,26072710,26072711,26072712,26072713,26072714,26072715,26072716,26072717,26072718,26072719?tags=pet_fonce,flou,pet_clair,environnement,autre,mal_croppe,pehd,background,papier,carton,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1377890634, 1377890629, 1377890626, 1377890595, 1377890594, 1377890593, 1377890592, 1377890588, 1377890585, 1377890573, 1377890568, 1377890566] Looping around the photos to save general results len do output : 1 /26072156. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890634', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890629', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890626', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890595', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890594', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890593', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890592', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890588', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890585', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890573', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890568', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890566', None, None, None, None, None, '3555593') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.060063838958740234 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7591514587402344 time spend to save output : 0.06037092208862305 total time spend for step 4 : 1.8195223808288574 step5:final Wed Aug 20 09:41:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1377890634: ('0.1528929157021605',), 1377890629: ('0.1528929157021605',), 1377890626: ('0.1528929157021605',), 1377890595: ('0.1528929157021605',), 1377890594: ('0.1528929157021605',), 1377890593: ('0.1528929157021605',), 1377890592: ('0.1528929157021605',), 1377890588: ('0.1528929157021605',), 1377890585: ('0.1528929157021605',), 1377890573: ('0.1528929157021605',), 1377890568: ('0.1528929157021605',), 1377890566: ('0.1528929157021605',)} new output for save of step final : {1377890634: ('0.1528929157021605',), 1377890629: ('0.1528929157021605',), 1377890626: ('0.1528929157021605',), 1377890595: ('0.1528929157021605',), 1377890594: ('0.1528929157021605',), 1377890593: ('0.1528929157021605',), 1377890592: ('0.1528929157021605',), 1377890588: ('0.1528929157021605',), 1377890585: ('0.1528929157021605',), 1377890573: ('0.1528929157021605',), 1377890568: ('0.1528929157021605',), 1377890566: ('0.1528929157021605',)} [1377890634, 1377890629, 1377890626, 1377890595, 1377890594, 1377890593, 1377890592, 1377890588, 1377890585, 1377890573, 1377890568, 1377890566] Looping around the photos to save general results len do output : 12 /1377890634.Didn't retrieve data . /1377890629.Didn't retrieve data . /1377890626.Didn't retrieve data . /1377890595.Didn't retrieve data . /1377890594.Didn't retrieve data . /1377890593.Didn't retrieve data . /1377890592.Didn't retrieve data . /1377890588.Didn't retrieve data . /1377890585.Didn't retrieve data . /1377890573.Didn't retrieve data . /1377890568.Didn't retrieve data . /1377890566.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890634', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890629', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890626', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890595', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890594', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890593', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890592', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890588', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890585', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890573', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890568', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890566', None, None, None, None, None, '3555593') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.016533374786376953 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12432408332824707 time spend to save output : 0.01708698272705078 total time spend for step 5 : 0.14141106605529785 step6:blur_detection Wed Aug 20 09:41:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1755675628_1442619_1377890634_bd1f36e8a81950e166351282c46218c3.jpg resize: (1080, 1920) 1377890634 -2.545508399302219 treat image : temp/1755675628_1442619_1377890629_2f978bdf7845249484c35a6de702f079.jpg resize: (1080, 1920) 1377890629 -2.8935107027951905 treat image : temp/1755675628_1442619_1377890626_cc8a16a0b1e3e8661c55b9d95bbf87f5.jpg resize: (1080, 1920) 1377890626 -2.9189358305584423 treat image : temp/1755675628_1442619_1377890595_b2b2b3fdfcb2baf4a53089ff3a0b0034.jpg resize: (1080, 1920) 1377890595 -2.56737831023365 treat image : temp/1755675628_1442619_1377890594_740630b341c148a8f107adc55a63191f.jpg resize: (1080, 1920) 1377890594 -1.4938645841213631 treat image : temp/1755675628_1442619_1377890593_6cd203b87186cc78c772a9073ff914d3.jpg resize: (1080, 1920) 1377890593 -1.693288990209459 treat image : temp/1755675628_1442619_1377890592_fdbbffba5de25d313a5d99ecf2e8d100.jpg resize: (1080, 1920) 1377890592 -2.874125743349162 treat image : temp/1755675628_1442619_1377890588_646b21ab7c182770674ed4108b6e274c.jpg resize: (1080, 1920) 1377890588 -2.4395038783924177 treat image : temp/1755675628_1442619_1377890585_e314e62bf11b9d2a5efd881b4256b51e.jpg resize: (1080, 1920) 1377890585 -2.5785733229301115 treat image : temp/1755675628_1442619_1377890573_1b46c023d2d767168fd8d2b5dedf1f85.jpg resize: (1080, 1920) 1377890573 -4.379760384217315 treat image : temp/1755675628_1442619_1377890568_a320f3d8678e3c40a811061f5805309d.jpg resize: (1080, 1920) 1377890568 -2.1456462659115694 treat image : temp/1755675628_1442619_1377890566_bb1c44d5c9e8c350eac00a3a19c09f79.jpg resize: (1080, 1920) 1377890566 -2.9306439761239877 treat image : temp/1755675628_1442619_1377890634_bd1f36e8a81950e166351282c46218c3_rle_crop_3921332747_0.png resize: (176, 101) 1377994697 -0.6104242195429089 treat image : temp/1755675628_1442619_1377890634_bd1f36e8a81950e166351282c46218c3_rle_crop_3921332748_0.png resize: (73, 125) 1377994698 -1.545189428204892 treat image : temp/1755675628_1442619_1377890634_bd1f36e8a81950e166351282c46218c3_rle_crop_3921332746_0.png resize: (164, 75) 1377994699 -2.3845143164197666 treat image : temp/1755675628_1442619_1377890593_6cd203b87186cc78c772a9073ff914d3_rle_crop_3921332756_0.png resize: (184, 106) 1377994700 -0.5495994008648127 treat image : temp/1755675628_1442619_1377890592_fdbbffba5de25d313a5d99ecf2e8d100_rle_crop_3921332758_0.png resize: (92, 115) 1377994701 -1.4903300926818295 treat image : temp/1755675628_1442619_1377890585_e314e62bf11b9d2a5efd881b4256b51e_rle_crop_3921332760_0.png resize: (188, 123) 1377994702 -0.5474209873974695 treat image : temp/1755675628_1442619_1377890566_bb1c44d5c9e8c350eac00a3a19c09f79_rle_crop_3921332768_0.png resize: (173, 106) 1377994703 -0.650757034854148 treat image : temp/1755675628_1442619_1377890573_1b46c023d2d767168fd8d2b5dedf1f85_rle_crop_3921332764_0.png resize: (524, 353) 1377994705 -0.4151789275147214 treat image : temp/1755675628_1442619_1377890568_a320f3d8678e3c40a811061f5805309d_rle_crop_3921332765_0.png resize: (121, 92) 1377994706 -1.1769345670957287 treat image : temp/1755675628_1442619_1377890566_bb1c44d5c9e8c350eac00a3a19c09f79_rle_crop_3921332769_0.png resize: (39, 81) 1377994707 20.0 treat image : temp/1755675628_1442619_1377890626_cc8a16a0b1e3e8661c55b9d95bbf87f5_rle_crop_3921332749_0.png resize: (935, 928) 1377994721 0.13864276776631043 treat image : temp/1755675628_1442619_1377890626_cc8a16a0b1e3e8661c55b9d95bbf87f5_rle_crop_3921332751_0.png resize: (157, 356) 1377994722 -2.6440719252600577 treat image : temp/1755675628_1442619_1377890626_cc8a16a0b1e3e8661c55b9d95bbf87f5_rle_crop_3921332750_0.png resize: (129, 211) 1377994723 -2.153338384696573 treat image : temp/1755675628_1442619_1377890595_b2b2b3fdfcb2baf4a53089ff3a0b0034_rle_crop_3921332753_0.png resize: (950, 1048) 1377994724 -0.10789816657411429 treat image : temp/1755675628_1442619_1377890595_b2b2b3fdfcb2baf4a53089ff3a0b0034_rle_crop_3921332752_0.png resize: (159, 140) 1377994725 -1.4130675027690212 treat image : temp/1755675628_1442619_1377890594_740630b341c148a8f107adc55a63191f_rle_crop_3921332754_0.png resize: (960, 1083) 1377994726 -0.3404874110080386 treat image : temp/1755675628_1442619_1377890593_6cd203b87186cc78c772a9073ff914d3_rle_crop_3921332757_0.png resize: (1006, 1307) 1377994727 -2.011702835481663 treat image : temp/1755675628_1442619_1377890593_6cd203b87186cc78c772a9073ff914d3_rle_crop_3921332755_0.png resize: (154, 139) 1377994728 -3.124062953522752 treat image : temp/1755675628_1442619_1377890588_646b21ab7c182770674ed4108b6e274c_rle_crop_3921332759_0.png resize: (162, 176) 1377994729 -2.882138790185636 treat image : temp/1755675628_1442619_1377890585_e314e62bf11b9d2a5efd881b4256b51e_rle_crop_3921332761_0.png resize: (509, 334) 1377994730 -0.6749670916625056 treat image : temp/1755675628_1442619_1377890573_1b46c023d2d767168fd8d2b5dedf1f85_rle_crop_3921332762_0.png resize: (521, 331) 1377994731 0.25184546968888144 treat image : temp/1755675628_1442619_1377890568_a320f3d8678e3c40a811061f5805309d_rle_crop_3921332767_0.png resize: (127, 121) 1377994732 -5.011245457095885 treat image : temp/1755675628_1442619_1377890573_1b46c023d2d767168fd8d2b5dedf1f85_rle_crop_3921332763_0.png resize: (133, 125) 1377994733 -3.3102262592419396 treat image : temp/1755675628_1442619_1377890568_a320f3d8678e3c40a811061f5805309d_rle_crop_3921332766_0.png resize: (71, 61) 1377994734 -4.550936142618118 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 36 time used for this insertion : 0.013479232788085938 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 36 time used for this insertion : 0.2507669925689697 save missing photos in datou_result : time spend for datou_step_exec : 11.082930326461792 time spend to save output : 0.26971864700317383 total time spend for step 6 : 11.352648973464966 step7:brightness Wed Aug 20 09:41:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1755675628_1442619_1377890634_bd1f36e8a81950e166351282c46218c3.jpg treat image : temp/1755675628_1442619_1377890629_2f978bdf7845249484c35a6de702f079.jpg treat image : temp/1755675628_1442619_1377890626_cc8a16a0b1e3e8661c55b9d95bbf87f5.jpg treat image : temp/1755675628_1442619_1377890595_b2b2b3fdfcb2baf4a53089ff3a0b0034.jpg treat image : temp/1755675628_1442619_1377890594_740630b341c148a8f107adc55a63191f.jpg treat image : temp/1755675628_1442619_1377890593_6cd203b87186cc78c772a9073ff914d3.jpg treat image : temp/1755675628_1442619_1377890592_fdbbffba5de25d313a5d99ecf2e8d100.jpg treat image : temp/1755675628_1442619_1377890588_646b21ab7c182770674ed4108b6e274c.jpg treat image : temp/1755675628_1442619_1377890585_e314e62bf11b9d2a5efd881b4256b51e.jpg treat image : temp/1755675628_1442619_1377890573_1b46c023d2d767168fd8d2b5dedf1f85.jpg treat image : temp/1755675628_1442619_1377890568_a320f3d8678e3c40a811061f5805309d.jpg treat image : temp/1755675628_1442619_1377890566_bb1c44d5c9e8c350eac00a3a19c09f79.jpg treat image : temp/1755675628_1442619_1377890634_bd1f36e8a81950e166351282c46218c3_rle_crop_3921332747_0.png treat image : temp/1755675628_1442619_1377890634_bd1f36e8a81950e166351282c46218c3_rle_crop_3921332748_0.png treat image : temp/1755675628_1442619_1377890634_bd1f36e8a81950e166351282c46218c3_rle_crop_3921332746_0.png treat image : temp/1755675628_1442619_1377890593_6cd203b87186cc78c772a9073ff914d3_rle_crop_3921332756_0.png treat image : temp/1755675628_1442619_1377890592_fdbbffba5de25d313a5d99ecf2e8d100_rle_crop_3921332758_0.png treat image : temp/1755675628_1442619_1377890585_e314e62bf11b9d2a5efd881b4256b51e_rle_crop_3921332760_0.png treat image : temp/1755675628_1442619_1377890566_bb1c44d5c9e8c350eac00a3a19c09f79_rle_crop_3921332768_0.png treat image : temp/1755675628_1442619_1377890573_1b46c023d2d767168fd8d2b5dedf1f85_rle_crop_3921332764_0.png treat image : temp/1755675628_1442619_1377890568_a320f3d8678e3c40a811061f5805309d_rle_crop_3921332765_0.png treat image : temp/1755675628_1442619_1377890566_bb1c44d5c9e8c350eac00a3a19c09f79_rle_crop_3921332769_0.png treat image : temp/1755675628_1442619_1377890626_cc8a16a0b1e3e8661c55b9d95bbf87f5_rle_crop_3921332749_0.png treat image : temp/1755675628_1442619_1377890626_cc8a16a0b1e3e8661c55b9d95bbf87f5_rle_crop_3921332751_0.png treat image : temp/1755675628_1442619_1377890626_cc8a16a0b1e3e8661c55b9d95bbf87f5_rle_crop_3921332750_0.png treat image : temp/1755675628_1442619_1377890595_b2b2b3fdfcb2baf4a53089ff3a0b0034_rle_crop_3921332753_0.png treat image : temp/1755675628_1442619_1377890595_b2b2b3fdfcb2baf4a53089ff3a0b0034_rle_crop_3921332752_0.png treat image : temp/1755675628_1442619_1377890594_740630b341c148a8f107adc55a63191f_rle_crop_3921332754_0.png treat image : temp/1755675628_1442619_1377890593_6cd203b87186cc78c772a9073ff914d3_rle_crop_3921332757_0.png treat image : temp/1755675628_1442619_1377890593_6cd203b87186cc78c772a9073ff914d3_rle_crop_3921332755_0.png treat image : temp/1755675628_1442619_1377890588_646b21ab7c182770674ed4108b6e274c_rle_crop_3921332759_0.png treat image : temp/1755675628_1442619_1377890585_e314e62bf11b9d2a5efd881b4256b51e_rle_crop_3921332761_0.png treat image : temp/1755675628_1442619_1377890573_1b46c023d2d767168fd8d2b5dedf1f85_rle_crop_3921332762_0.png treat image : temp/1755675628_1442619_1377890568_a320f3d8678e3c40a811061f5805309d_rle_crop_3921332767_0.png treat image : temp/1755675628_1442619_1377890573_1b46c023d2d767168fd8d2b5dedf1f85_rle_crop_3921332763_0.png treat image : temp/1755675628_1442619_1377890568_a320f3d8678e3c40a811061f5805309d_rle_crop_3921332766_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 36 time used for this insertion : 0.0145721435546875 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 36 time used for this insertion : 0.01592397689819336 save missing photos in datou_result : time spend for datou_step_exec : 3.2824416160583496 time spend to save output : 0.0347743034362793 total time spend for step 7 : 3.317215919494629 step8:velours_tree Wed Aug 20 09:41:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.13471293449401855 time spend to save output : 4.673004150390625e-05 total time spend for step 8 : 0.13475966453552246 step9:send_mail_cod Wed Aug 20 09:41:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26072156_20-08-2025_09_41_51.pdf 26072709 imagette260727091755675711 26072710 imagette260727101755675711 26072711 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette260727111755675711 26072713 change filename to text .change filename to text .imagette260727131755675712 26072714 imagette260727141755675712 26072715 imagette260727151755675712 26072716 imagette260727161755675712 26072717 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette260727171755675712 26072718 change filename to text .change filename to text .change filename to text .imagette260727181755675713 26072719 imagette260727191755675713 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26072156 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/26072709,26072710,26072711,26072712,26072713,26072714,26072715,26072716,26072717,26072718,26072719?tags=pet_fonce,flou,pet_clair,environnement,autre,mal_croppe,pehd,background,papier,carton,metal args[1377890634] : ((1377890634, -2.545508399302219, 492609224), (1377890634, 0.4543711185643858, 2107752395), '0.1528929157021605') We are sending mail with results at report@fotonower.com args[1377890629] : ((1377890629, -2.8935107027951905, 492609224), (1377890629, 0.36489828100371213, 2107752395), '0.1528929157021605') We are sending mail with results at report@fotonower.com args[1377890626] : ((1377890626, -2.9189358305584423, 492609224), (1377890626, 0.521628853555116, 2107752395), '0.1528929157021605') We are sending mail with results at report@fotonower.com args[1377890595] : ((1377890595, -2.56737831023365, 492609224), (1377890595, 0.5733148485222905, 2107752395), '0.1528929157021605') We are sending mail with results at report@fotonower.com args[1377890594] : ((1377890594, -1.4938645841213631, 492688767), (1377890594, 0.4283362820134942, 2107752395), '0.1528929157021605') We are sending mail with results at report@fotonower.com args[1377890593] : ((1377890593, -1.693288990209459, 492688767), (1377890593, 0.4504140634714551, 2107752395), '0.1528929157021605') We are sending mail with results at report@fotonower.com args[1377890592] : ((1377890592, -2.874125743349162, 492609224), (1377890592, 0.4908164408644694, 2107752395), '0.1528929157021605') We are sending mail with results at report@fotonower.com args[1377890588] : ((1377890588, -2.4395038783924177, 492609224), (1377890588, 0.5339084043890938, 2107752395), '0.1528929157021605') We are sending mail with results at report@fotonower.com args[1377890585] : ((1377890585, -2.5785733229301115, 492609224), (1377890585, 0.3638507346294814, 2107752395), '0.1528929157021605') We are sending mail with results at report@fotonower.com args[1377890573] : ((1377890573, -4.379760384217315, 492609224), (1377890573, 0.473510334167584, 2107752395), '0.1528929157021605') We are sending mail with results at report@fotonower.com args[1377890568] : ((1377890568, -2.1456462659115694, 492609224), (1377890568, 0.39568749955550203, 2107752395), '0.1528929157021605') We are sending mail with results at report@fotonower.com args[1377890566] : ((1377890566, -2.9306439761239877, 492609224), (1377890566, 0.5261704115422354, 2107752395), '0.1528929157021605') We are sending mail with results at report@fotonower.com refus_total : 0.1528929157021605 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26072156 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26072156_20-08-2025_09_41_51.pdf results_Auto_P26072156_20-08-2025_09_41_51.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26072156_20-08-2025_09_41_51.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26072156','results_Auto_P26072156_20-08-2025_09_41_51.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26072156_20-08-2025_09_41_51.pdf','pdf','','0.48','0.1528929157021605') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26072156

https://www.fotonower.com/image?json=false&list_photos_id=1377890634
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890629
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890626
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890595
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890594
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890593
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890592
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890588
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890585
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890573
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890568
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890566
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 15.29%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/26072711?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26072713?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26072717?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26072718?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26072156_20-08-2025_09_41_51.pdf.

Lien vers velours :https://www.fotonower.com/velours/26072709,26072710,26072711,26072712,26072713,26072714,26072715,26072716,26072717,26072718,26072719?tags=pet_fonce,flou,pet_clair,environnement,autre,mal_croppe,pehd,background,papier,carton,metal.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 20 Aug 2025 07:41:55 GMT Content-Length: 0 Connection: close X-Message-Id: 4iuwuvlfSAmefvVal0UAtQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1377890634, 1377890629, 1377890626, 1377890595, 1377890594, 1377890593, 1377890592, 1377890588, 1377890585, 1377890573, 1377890568, 1377890566] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890634', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890629', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890626', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890595', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890594', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890593', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890592', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890588', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890585', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890573', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890568', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890566', None, None, None, None, None, '3555593') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.08769464492797852 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.59000301361084 time spend to save output : 0.0883936882019043 total time spend for step 9 : 3.678396701812744 step10:split_time_score Wed Aug 20 09:41:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 12),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 19082025 26072156 Nombre de photos uploadées : 12 / 23040 (0%) 19082025 26072156 Nombre de photos taguées (types de déchets): 0 / 12 (0%) 19082025 26072156 Nombre de photos taguées (volume) : 0 / 12 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ???????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005922317504882812 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20721220970153809 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072114 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072115 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072116 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072119 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072121 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072123 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072142 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072146 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072150 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072152 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072154 order by id desc limit 1 Qualite : 0.1528929157021605 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26072156_20-08-2025_09_41_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072156 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26072156 AND mptpi.`type`=3594 To do Qualite : 0.14430815972222225 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26072158_20-08-2025_09_31_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072158 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26072158 AND mptpi.`type`=3594 To do Qualite : 0.09642829585537918 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26072161_20-08-2025_09_22_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072161 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26072161 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'19082025': {'nb_upload': 12, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1377890634, 1377890629, 1377890626, 1377890595, 1377890594, 1377890593, 1377890592, 1377890588, 1377890585, 1377890573, 1377890568, 1377890566] Looping around the photos to save general results len do output : 1 /26072156Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890634', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890629', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890626', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890595', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890594', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890593', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890592', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890588', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890585', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890573', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890568', None, None, None, None, None, '3555593') ('3318', None, None, None, None, None, None, None, '3555593') ('3318', '26072156', '1377890566', None, None, None, None, None, '3555593') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.01801896095275879 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.062087535858154 time spend to save output : 0.01823878288269043 total time spend for step 10 : 11.080326318740845 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 12 set_done_treatment 52.20user 21.82system 1:41.02elapsed 73%CPU (0avgtext+0avgdata 2767620maxresident)k 56800inputs+33616outputs (201major+1708442minor)pagefaults 0swaps