python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 793668 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3733246'] with mtr_portfolio_ids : ['26929261'] and first list_photo_ids : [] new path : /proc/793668/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 40 ; length of list_pids : 40 ; length of list_args : 40 time to download the photos : 5.822166442871094 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Sep 17 07:40:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10433 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-17 07:40:37.046827: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-17 07:40:37.072570: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-17 07:40:37.074644: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fd90c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-17 07:40:37.074700: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-17 07:40:37.078667: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-17 07:40:37.231482: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xe712190 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-17 07:40:37.231543: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-17 07:40:37.233043: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-17 07:40:37.233485: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-17 07:40:37.236770: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-17 07:40:37.239901: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-17 07:40:37.240481: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-17 07:40:37.243026: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-17 07:40:37.244070: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-17 07:40:37.248648: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-17 07:40:37.250137: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-17 07:40:37.250207: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-17 07:40:37.250953: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-17 07:40:37.250968: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-17 07:40:37.250995: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-17 07:40:37.252266: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9664 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-17 07:40:37.511557: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-17 07:40:37.511689: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-17 07:40:37.512432: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-17 07:40:37.512459: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-17 07:40:37.512478: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-17 07:40:37.512496: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-17 07:40:37.512513: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-17 07:40:37.512531: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-17 07:40:37.514203: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-17 07:40:37.515690: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-17 07:40:37.515730: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-17 07:40:37.515749: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-17 07:40:37.515766: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-17 07:40:37.515783: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-17 07:40:37.515800: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-17 07:40:37.515817: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-17 07:40:37.515834: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-17 07:40:37.517531: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-17 07:40:37.517575: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-17 07:40:37.517587: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-17 07:40:37.517598: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-17 07:40:37.518885: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9664 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-17 07:40:46.792805: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-17 07:40:47.005198: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 40 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 0 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 Detection mask done ! Trying to reset tf kernel 794613 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 327 tf kernel not reseted sub process len(results) : 40 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 40 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6809 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0019500255584716797 nb_pixel_total : 101809 time to create 1 rle with old method : 0.12136292457580566 length of segment : 499 time for calcul the mask position with numpy : 0.18190670013427734 nb_pixel_total : 1210739 time to create 1 rle with new method : 0.06690573692321777 length of segment : 1204 time for calcul the mask position with numpy : 0.019793033599853516 nb_pixel_total : 1119544 time to create 1 rle with new method : 0.06631922721862793 length of segment : 1836 time for calcul the mask position with numpy : 0.02665853500366211 nb_pixel_total : 1125296 time to create 1 rle with new method : 0.06652426719665527 length of segment : 1772 time for calcul the mask position with numpy : 0.0011608600616455078 nb_pixel_total : 94900 time to create 1 rle with old method : 0.10790657997131348 length of segment : 485 time for calcul the mask position with numpy : 0.011500358581542969 nb_pixel_total : 937768 time to create 1 rle with new method : 0.05279374122619629 length of segment : 1860 time for calcul the mask position with numpy : 0.017198801040649414 nb_pixel_total : 1072058 time to create 1 rle with new method : 0.14877629280090332 length of segment : 1875 time for calcul the mask position with numpy : 0.0005452632904052734 nb_pixel_total : 22394 time to create 1 rle with old method : 0.02569293975830078 length of segment : 270 time for calcul the mask position with numpy : 0.012573719024658203 nb_pixel_total : 1022741 time to create 1 rle with new method : 0.1474168300628662 length of segment : 1627 time for calcul the mask position with numpy : 0.0015938282012939453 nb_pixel_total : 96291 time to create 1 rle with old method : 0.1128842830657959 length of segment : 471 time for calcul the mask position with numpy : 0.0197904109954834 nb_pixel_total : 976993 time to create 1 rle with new method : 0.0632476806640625 length of segment : 2121 time for calcul the mask position with numpy : 0.01570415496826172 nb_pixel_total : 1043930 time to create 1 rle with new method : 0.18654370307922363 length of segment : 1876 time for calcul the mask position with numpy : 0.001512289047241211 nb_pixel_total : 94217 time to create 1 rle with old method : 0.10658764839172363 length of segment : 480 time for calcul the mask position with numpy : 0.013973474502563477 nb_pixel_total : 1006934 time to create 1 rle with new method : 0.38856983184814453 length of segment : 1822 time spent for convertir_results : 6.745924949645996 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 32 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 14180 save missing photos in datou_result : time spend for datou_step_exec : 40.789788246154785 time spend to save output : 1.5431725978851318 total time spend for step 1 : 42.33296084403992 step2:crop_condition Wed Sep 17 07:41:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 40 ! batch 1 Loaded 41 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 3736932 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758087762_793668 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 24 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.87546706199646 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758087774_793668 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8554048538208008 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1758087777_793668 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.7500512599945068 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1384057886, 1384057860, 1384057835, 1384035797, 1384035700, 1384035684, 1384035670, 1384035662, 1384035618, 1384035611, 1384035604, 1384035596, 1384035574, 1384035556, 1384035551, 1384035524, 1384035502, 1384035454, 1384035431, 1384035380, 1384035374, 1384035348, 1384035342, 1384035326, 1384035301, 1384035267, 1384035249, 1384035235, 1384035213, 1384035202, 1384035152, 1384035136, 1384035090, 1384035056, 1384035032, 1384035010, 1384034996, 1384034946, 1384034896, 1384034736] Looping around the photos to save general results len do output : 31 /1384064619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1384064684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384057886', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384057860', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384057835', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035797', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035700', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035684', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035670', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035662', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035618', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035611', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035604', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035596', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035574', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035556', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035551', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035524', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035502', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035454', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035431', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035380', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035374', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035348', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035342', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035326', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035301', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035267', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035249', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035235', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035213', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035202', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035152', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035136', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035090', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035056', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035032', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035010', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034996', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034946', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034896', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034736', None, None, None, None, None, '3733246') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 133 time used for this insertion : 0.6254239082336426 save_final save missing photos in datou_result : time spend for datou_step_exec : 102.875314950943 time spend to save output : 0.6267011165618896 total time spend for step 2 : 103.50201606750488 step3:rle_unique_nms_with_priority Wed Sep 17 07:43:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 41 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.2571091651916504 time for calcul the mask position with numpy : 0.08772540092468262 nb_pixel_total : 1971791 time to create 1 rle with new method : 0.10904550552368164 time for calcul the mask position with numpy : 0.007101535797119141 nb_pixel_total : 101809 time to create 1 rle with old method : 0.1179046630859375 create new chi : 0.33351826667785645 time to delete rle : 0.027947187423706055 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2078 TO DO : save crop sub photo not yet done ! save time : 0.26129770278930664 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.17991018295288086 time for calcul the mask position with numpy : 0.028048276901245117 nb_pixel_total : 862861 time to create 1 rle with new method : 0.18998312950134277 time for calcul the mask position with numpy : 0.034914493560791016 nb_pixel_total : 1210739 time to create 1 rle with new method : 0.21022415161132812 create new chi : 0.47861623764038086 time to delete rle : 0.0004887580871582031 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 3488 TO DO : save crop sub photo not yet done ! save time : 0.48305654525756836 No data in photo_id : 1384057835 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.11116790771484375 time for calcul the mask position with numpy : 0.014387369155883789 nb_pixel_total : 1120252 time to create 1 rle with new method : 0.1520366668701172 time for calcul the mask position with numpy : 0.012690067291259766 nb_pixel_total : 953348 time to create 1 rle with new method : 0.20046758651733398 create new chi : 0.40070533752441406 time to delete rle : 0.0006585121154785156 batch 1 Loaded 4 chid ids of type : 3594 ++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.07276511192321777 No data in photo_id : 1384035700 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.0687108039855957 time for calcul the mask position with numpy : 0.006086826324462891 nb_pixel_total : 22709 time to create 1 rle with old method : 0.026537179946899414 time for calcul the mask position with numpy : 0.019607067108154297 nb_pixel_total : 2050891 time to create 1 rle with new method : 0.2104349136352539 create new chi : 0.2813453674316406 time to delete rle : 0.0006642341613769531 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.038329124450683594 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.11614608764648438 time for calcul the mask position with numpy : 0.006386280059814453 nb_pixel_total : 46219 time to create 1 rle with old method : 0.059209346771240234 time for calcul the mask position with numpy : 0.014608621597290039 nb_pixel_total : 1098161 time to create 1 rle with new method : 0.2017502784729004 time for calcul the mask position with numpy : 0.01241755485534668 nb_pixel_total : 929220 time to create 1 rle with new method : 0.07918453216552734 create new chi : 0.3948330879211426 time to delete rle : 0.0013172626495361328 batch 1 Loaded 7 chid ids of type : 3594 ++++++++Number RLEs to save : 3592 TO DO : save crop sub photo not yet done ! save time : 0.44515299797058105 No data in photo_id : 1384035662 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.05584716796875 time for calcul the mask position with numpy : 0.0077266693115234375 nb_pixel_total : 176418 time to create 1 rle with new method : 0.15909647941589355 time for calcul the mask position with numpy : 0.017870187759399414 nb_pixel_total : 1897182 time to create 1 rle with new method : 0.06343221664428711 create new chi : 0.2628357410430908 time to delete rle : 0.0006113052368164062 batch 1 Loaded 3 chid ids of type : 3594 +++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.06133413314819336 No data in photo_id : 1384035611 No data in photo_id : 1384035604 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.20217442512512207 time for calcul the mask position with numpy : 0.009531021118164062 nb_pixel_total : 260919 time to create 1 rle with new method : 0.07595300674438477 time for calcul the mask position with numpy : 0.011608600616455078 nb_pixel_total : 805877 time to create 1 rle with new method : 0.1447157859802246 time for calcul the mask position with numpy : 0.012938737869262695 nb_pixel_total : 1006804 time to create 1 rle with new method : 0.07806825637817383 create new chi : 0.35294413566589355 time to delete rle : 0.0008969306945800781 batch 1 Loaded 6 chid ids of type : 3594 ++++Number RLEs to save : 3179 TO DO : save crop sub photo not yet done ! save time : 0.29128003120422363 No data in photo_id : 1384035574 No data in photo_id : 1384035556 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.05888199806213379 time for calcul the mask position with numpy : 0.013225793838500977 nb_pixel_total : 1067765 time to create 1 rle with new method : 0.14714980125427246 time for calcul the mask position with numpy : 0.012989044189453125 nb_pixel_total : 1005835 time to create 1 rle with new method : 0.15018367767333984 create new chi : 0.3426501750946045 time to delete rle : 0.0007145404815673828 batch 1 Loaded 4 chid ids of type : 3594 ++++++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.07192802429199219 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.06762838363647461 time for calcul the mask position with numpy : 0.0058171749114990234 nb_pixel_total : 22389 time to create 1 rle with old method : 0.024431705474853516 time for calcul the mask position with numpy : 0.11123776435852051 nb_pixel_total : 2051211 time to create 1 rle with new method : 0.06500816345214844 create new chi : 0.21586084365844727 time to delete rle : 0.0004947185516357422 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.053783416748046875 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.051517486572265625 time for calcul the mask position with numpy : 0.09709787368774414 nb_pixel_total : 1022772 time to create 1 rle with new method : 0.07561421394348145 time for calcul the mask position with numpy : 0.03169608116149902 nb_pixel_total : 1050828 time to create 1 rle with new method : 0.15291213989257812 create new chi : 0.3871793746948242 time to delete rle : 0.0006320476531982422 batch 1 Loaded 3 chid ids of type : 3594 ++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.08885002136230469 No data in photo_id : 1384035454 No data in photo_id : 1384035431 No data in photo_id : 1384035380 No data in photo_id : 1384035374 No data in photo_id : 1384035348 No data in photo_id : 1384035342 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.0764472484588623 time for calcul the mask position with numpy : 0.013011932373046875 nb_pixel_total : 1043617 time to create 1 rle with new method : 0.15208125114440918 time for calcul the mask position with numpy : 0.012702465057373047 nb_pixel_total : 1029983 time to create 1 rle with new method : 0.1504824161529541 create new chi : 0.3476414680480957 time to delete rle : 0.0007684230804443359 batch 1 Loaded 3 chid ids of type : 3594 ++++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.09745359420776367 No data in photo_id : 1384035301 No data in photo_id : 1384035267 No data in photo_id : 1384035249 No data in photo_id : 1384035235 No data in photo_id : 1384035213 No data in photo_id : 1384035202 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03404426574707031 time for calcul the mask position with numpy : 0.04116010665893555 nb_pixel_total : 1977309 time to create 1 rle with new method : 0.1575911045074463 time for calcul the mask position with numpy : 0.0067327022552490234 nb_pixel_total : 96291 time to create 1 rle with old method : 0.11119270324707031 create new chi : 0.3271903991699219 time to delete rle : 0.0005910396575927734 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2022 TO DO : save crop sub photo not yet done ! save time : 0.22572755813598633 No data in photo_id : 1384035136 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.10608673095703125 time for calcul the mask position with numpy : 0.014873027801513672 nb_pixel_total : 977657 time to create 1 rle with new method : 0.1325995922088623 time for calcul the mask position with numpy : 0.03465700149536133 nb_pixel_total : 1095943 time to create 1 rle with new method : 0.16439461708068848 create new chi : 0.36754703521728516 time to delete rle : 0.0006608963012695312 batch 1 Loaded 3 chid ids of type : 3594 +++Number RLEs to save : 0 TO DO : save crop sub photo not yet done ! save time : 0.07128286361694336 No data in photo_id : 1384035056 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.0356287956237793 time for calcul the mask position with numpy : 0.012812376022338867 nb_pixel_total : 1029670 time to create 1 rle with new method : 0.07892298698425293 time for calcul the mask position with numpy : 0.01608419418334961 nb_pixel_total : 1043930 time to create 1 rle with new method : 0.15688061714172363 create new chi : 0.2812685966491699 time to delete rle : 0.00095367431640625 batch 1 Loaded 3 chid ids of type : 3594 +++Number RLEs to save : 4832 TO DO : save crop sub photo not yet done ! save time : 0.43636441230773926 No data in photo_id : 1384035010 No data in photo_id : 1384034996 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03438687324523926 time for calcul the mask position with numpy : 0.06354665756225586 nb_pixel_total : 1979383 time to create 1 rle with new method : 0.1700751781463623 time for calcul the mask position with numpy : 0.0064465999603271484 nb_pixel_total : 94217 time to create 1 rle with old method : 0.11345863342285156 create new chi : 0.36335206031799316 time to delete rle : 0.0005567073822021484 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2040 TO DO : save crop sub photo not yet done ! save time : 0.22753095626831055 No data in photo_id : 1384034896 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03705954551696777 time for calcul the mask position with numpy : 0.03348207473754883 nb_pixel_total : 1066666 time to create 1 rle with new method : 0.1641390323638916 time for calcul the mask position with numpy : 0.012823820114135742 nb_pixel_total : 1006934 time to create 1 rle with new method : 0.07602953910827637 create new chi : 0.30248427391052246 time to delete rle : 0.0006496906280517578 batch 1 Loaded 3 chid ids of type : 3594 +++Number RLEs to save : 4724 TO DO : save crop sub photo not yet done ! save time : 0.37044739723205566 map_output_result : {1384057886: (0.0, 'Should be the crop_list due to order', 0), 1384057860: (0.0, 'Should be the crop_list due to order', 0), 1384057835: (0.0, 'Should be the crop_list due to order', 0.0), 1384035797: (0.0, 'Should be the crop_list due to order', 0), 1384035700: (0.0, 'Should be the crop_list due to order', 0.0), 1384035684: (0.0, 'Should be the crop_list due to order', 0), 1384035670: (0.0, 'Should be the crop_list due to order', 0), 1384035662: (0.0, 'Should be the crop_list due to order', 0.0), 1384035618: (0.0, 'Should be the crop_list due to order', 0), 1384035611: (0.0, 'Should be the crop_list due to order', 0.0), 1384035604: (0.0, 'Should be the crop_list due to order', 0.0), 1384035596: (0.0, 'Should be the crop_list due to order', 0), 1384035574: (0.0, 'Should be the crop_list due to order', 0.0), 1384035556: (0.0, 'Should be the crop_list due to order', 0.0), 1384035551: (0.0, 'Should be the crop_list due to order', 0), 1384035524: (0.0, 'Should be the crop_list due to order', 0), 1384035502: (0.0, 'Should be the crop_list due to order', 0), 1384035454: (0.0, 'Should be the crop_list due to order', 0.0), 1384035431: (0.0, 'Should be the crop_list due to order', 0.0), 1384035380: (0.0, 'Should be the crop_list due to order', 0.0), 1384035374: (0.0, 'Should be the crop_list due to order', 0.0), 1384035348: (0.0, 'Should be the crop_list due to order', 0.0), 1384035342: (0.0, 'Should be the crop_list due to order', 0.0), 1384035326: (0.0, 'Should be the crop_list due to order', 0), 1384035301: (0.0, 'Should be the crop_list due to order', 0.0), 1384035267: (0.0, 'Should be the crop_list due to order', 0.0), 1384035249: (0.0, 'Should be the crop_list due to order', 0.0), 1384035235: (0.0, 'Should be the crop_list due to order', 0.0), 1384035213: (0.0, 'Should be the crop_list due to order', 0.0), 1384035202: (0.0, 'Should be the crop_list due to order', 0.0), 1384035152: (0.0, 'Should be the crop_list due to order', 0), 1384035136: (0.0, 'Should be the crop_list due to order', 0.0), 1384035090: (0.0, 'Should be the crop_list due to order', 0), 1384035056: (0.0, 'Should be the crop_list due to order', 0.0), 1384035032: (0.0, 'Should be the crop_list due to order', 0), 1384035010: (0.0, 'Should be the crop_list due to order', 0.0), 1384034996: (0.0, 'Should be the crop_list due to order', 0.0), 1384034946: (0.0, 'Should be the crop_list due to order', 0), 1384034896: (0.0, 'Should be the crop_list due to order', 0.0), 1384034736: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1384057886, 1384057860, 1384057835, 1384035797, 1384035700, 1384035684, 1384035670, 1384035662, 1384035618, 1384035611, 1384035604, 1384035596, 1384035574, 1384035556, 1384035551, 1384035524, 1384035502, 1384035454, 1384035431, 1384035380, 1384035374, 1384035348, 1384035342, 1384035326, 1384035301, 1384035267, 1384035249, 1384035235, 1384035213, 1384035202, 1384035152, 1384035136, 1384035090, 1384035056, 1384035032, 1384035010, 1384034996, 1384034946, 1384034896, 1384034736] Looping around the photos to save general results len do output : 40 /1384057886.Didn't retrieve data . /1384057860.Didn't retrieve data . /1384057835.Didn't retrieve data . /1384035797.Didn't retrieve data . /1384035700.Didn't retrieve data . /1384035684.Didn't retrieve data . /1384035670.Didn't retrieve data . /1384035662.Didn't retrieve data . /1384035618.Didn't retrieve data . /1384035611.Didn't retrieve data . /1384035604.Didn't retrieve data . /1384035596.Didn't retrieve data . /1384035574.Didn't retrieve data . /1384035556.Didn't retrieve data . /1384035551.Didn't retrieve data . /1384035524.Didn't retrieve data . /1384035502.Didn't retrieve data . /1384035454.Didn't retrieve data . /1384035431.Didn't retrieve data . /1384035380.Didn't retrieve data . /1384035374.Didn't retrieve data . /1384035348.Didn't retrieve data . /1384035342.Didn't retrieve data . /1384035326.Didn't retrieve data . /1384035301.Didn't retrieve data . /1384035267.Didn't retrieve data . /1384035249.Didn't retrieve data . /1384035235.Didn't retrieve data . /1384035213.Didn't retrieve data . /1384035202.Didn't retrieve data . /1384035152.Didn't retrieve data . /1384035136.Didn't retrieve data . /1384035090.Didn't retrieve data . /1384035056.Didn't retrieve data . /1384035032.Didn't retrieve data . /1384035010.Didn't retrieve data . /1384034996.Didn't retrieve data . /1384034946.Didn't retrieve data . /1384034896.Didn't retrieve data . /1384034736.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384057886', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384057860', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384057835', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035797', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035700', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035684', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035670', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035662', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035618', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035611', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035604', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035596', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035574', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035556', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035551', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035524', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035502', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035454', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035431', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035380', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035374', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035348', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035342', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035326', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035301', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035267', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035249', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035235', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035213', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035202', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035152', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035136', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035090', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035056', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035032', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035010', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034996', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034946', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034896', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034736', None, None, None, None, None, '3733246') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 120 time used for this insertion : 0.0429692268371582 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.343070983886719 time spend to save output : 0.04386782646179199 total time spend for step 3 : 11.38693881034851 step4:ventilate_hashtags_in_portfolio Wed Sep 17 07:43:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26929261 get user id for portfolio 26929261 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26929261 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','carton','pehd','metal','background','mal_croppe','environnement','autre','papier','pet_clair','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26929261 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','carton','pehd','metal','background','mal_croppe','environnement','autre','papier','pet_clair','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26929261 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','carton','pehd','metal','background','mal_croppe','environnement','autre','papier','pet_clair','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26929423,26929424,26929425,26929426,26929427,26929428,26929429,26929430,26929431,26929432,26929433?tags=flou,carton,pehd,metal,background,mal_croppe,environnement,autre,papier,pet_clair,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1384057886, 1384057860, 1384057835, 1384035797, 1384035700, 1384035684, 1384035670, 1384035662, 1384035618, 1384035611, 1384035604, 1384035596, 1384035574, 1384035556, 1384035551, 1384035524, 1384035502, 1384035454, 1384035431, 1384035380, 1384035374, 1384035348, 1384035342, 1384035326, 1384035301, 1384035267, 1384035249, 1384035235, 1384035213, 1384035202, 1384035152, 1384035136, 1384035090, 1384035056, 1384035032, 1384035010, 1384034996, 1384034946, 1384034896, 1384034736] Looping around the photos to save general results len do output : 1 /26929261. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384057886', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384057860', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384057835', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035797', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035700', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035684', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035670', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035662', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035618', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035611', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035604', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035596', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035574', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035556', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035551', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035524', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035502', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035454', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035431', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035380', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035374', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035348', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035342', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035326', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035301', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035267', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035249', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035235', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035213', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035202', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035152', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035136', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035090', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035056', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035032', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035010', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034996', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034946', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034896', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034736', None, None, None, None, None, '3733246') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 41 time used for this insertion : 0.5755815505981445 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.8795409202575684 time spend to save output : 0.5761873722076416 total time spend for step 4 : 1.45572829246521 step5:final Wed Sep 17 07:43:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1384057886: ('0.07683520518975764',), 1384057860: ('0.07683520518975764',), 1384057835: ('0.07683520518975764',), 1384035797: ('0.07683520518975764',), 1384035700: ('0.07683520518975764',), 1384035684: ('0.07683520518975764',), 1384035670: ('0.07683520518975764',), 1384035662: ('0.07683520518975764',), 1384035618: ('0.07683520518975764',), 1384035611: ('0.07683520518975764',), 1384035604: ('0.07683520518975764',), 1384035596: ('0.07683520518975764',), 1384035574: ('0.07683520518975764',), 1384035556: ('0.07683520518975764',), 1384035551: ('0.07683520518975764',), 1384035524: ('0.07683520518975764',), 1384035502: ('0.07683520518975764',), 1384035454: ('0.07683520518975764',), 1384035431: ('0.07683520518975764',), 1384035380: ('0.07683520518975764',), 1384035374: ('0.07683520518975764',), 1384035348: ('0.07683520518975764',), 1384035342: ('0.07683520518975764',), 1384035326: ('0.07683520518975764',), 1384035301: ('0.07683520518975764',), 1384035267: ('0.07683520518975764',), 1384035249: ('0.07683520518975764',), 1384035235: ('0.07683520518975764',), 1384035213: ('0.07683520518975764',), 1384035202: ('0.07683520518975764',), 1384035152: ('0.07683520518975764',), 1384035136: ('0.07683520518975764',), 1384035090: ('0.07683520518975764',), 1384035056: ('0.07683520518975764',), 1384035032: ('0.07683520518975764',), 1384035010: ('0.07683520518975764',), 1384034996: ('0.07683520518975764',), 1384034946: ('0.07683520518975764',), 1384034896: ('0.07683520518975764',), 1384034736: ('0.07683520518975764',)} new output for save of step final : {1384057886: ('0.07683520518975764',), 1384057860: ('0.07683520518975764',), 1384057835: ('0.07683520518975764',), 1384035797: ('0.07683520518975764',), 1384035700: ('0.07683520518975764',), 1384035684: ('0.07683520518975764',), 1384035670: ('0.07683520518975764',), 1384035662: ('0.07683520518975764',), 1384035618: ('0.07683520518975764',), 1384035611: ('0.07683520518975764',), 1384035604: ('0.07683520518975764',), 1384035596: ('0.07683520518975764',), 1384035574: ('0.07683520518975764',), 1384035556: ('0.07683520518975764',), 1384035551: ('0.07683520518975764',), 1384035524: ('0.07683520518975764',), 1384035502: ('0.07683520518975764',), 1384035454: ('0.07683520518975764',), 1384035431: ('0.07683520518975764',), 1384035380: ('0.07683520518975764',), 1384035374: ('0.07683520518975764',), 1384035348: ('0.07683520518975764',), 1384035342: ('0.07683520518975764',), 1384035326: ('0.07683520518975764',), 1384035301: ('0.07683520518975764',), 1384035267: ('0.07683520518975764',), 1384035249: ('0.07683520518975764',), 1384035235: ('0.07683520518975764',), 1384035213: ('0.07683520518975764',), 1384035202: ('0.07683520518975764',), 1384035152: ('0.07683520518975764',), 1384035136: ('0.07683520518975764',), 1384035090: ('0.07683520518975764',), 1384035056: ('0.07683520518975764',), 1384035032: ('0.07683520518975764',), 1384035010: ('0.07683520518975764',), 1384034996: ('0.07683520518975764',), 1384034946: ('0.07683520518975764',), 1384034896: ('0.07683520518975764',), 1384034736: ('0.07683520518975764',)} [1384057886, 1384057860, 1384057835, 1384035797, 1384035700, 1384035684, 1384035670, 1384035662, 1384035618, 1384035611, 1384035604, 1384035596, 1384035574, 1384035556, 1384035551, 1384035524, 1384035502, 1384035454, 1384035431, 1384035380, 1384035374, 1384035348, 1384035342, 1384035326, 1384035301, 1384035267, 1384035249, 1384035235, 1384035213, 1384035202, 1384035152, 1384035136, 1384035090, 1384035056, 1384035032, 1384035010, 1384034996, 1384034946, 1384034896, 1384034736] Looping around the photos to save general results len do output : 40 /1384057886.Didn't retrieve data . /1384057860.Didn't retrieve data . /1384057835.Didn't retrieve data . /1384035797.Didn't retrieve data . /1384035700.Didn't retrieve data . /1384035684.Didn't retrieve data . /1384035670.Didn't retrieve data . /1384035662.Didn't retrieve data . /1384035618.Didn't retrieve data . /1384035611.Didn't retrieve data . /1384035604.Didn't retrieve data . /1384035596.Didn't retrieve data . /1384035574.Didn't retrieve data . /1384035556.Didn't retrieve data . /1384035551.Didn't retrieve data . /1384035524.Didn't retrieve data . /1384035502.Didn't retrieve data . /1384035454.Didn't retrieve data . /1384035431.Didn't retrieve data . /1384035380.Didn't retrieve data . /1384035374.Didn't retrieve data . /1384035348.Didn't retrieve data . /1384035342.Didn't retrieve data . /1384035326.Didn't retrieve data . /1384035301.Didn't retrieve data . /1384035267.Didn't retrieve data . /1384035249.Didn't retrieve data . /1384035235.Didn't retrieve data . /1384035213.Didn't retrieve data . /1384035202.Didn't retrieve data . /1384035152.Didn't retrieve data . /1384035136.Didn't retrieve data . /1384035090.Didn't retrieve data . /1384035056.Didn't retrieve data . /1384035032.Didn't retrieve data . /1384035010.Didn't retrieve data . /1384034996.Didn't retrieve data . /1384034946.Didn't retrieve data . /1384034896.Didn't retrieve data . /1384034736.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384057886', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384057860', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384057835', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035797', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035700', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035684', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035670', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035662', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035618', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035611', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035604', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035596', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035574', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035556', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035551', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035524', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035502', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035454', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035431', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035380', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035374', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035348', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035342', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035326', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035301', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035267', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035249', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035235', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035213', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035202', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035152', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035136', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035090', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035056', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035032', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035010', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034996', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034946', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034896', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034736', None, None, None, None, None, '3733246') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 120 time used for this insertion : 0.6828410625457764 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.17609405517578125 time spend to save output : 0.6843268871307373 total time spend for step 5 : 0.8604209423065186 step6:blur_detection Wed Sep 17 07:43:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1758087628_793668_1384057886_5ce533631014cf169f3234a672851180.jpg resize: (1080, 1920) 1384057886 9.912492783384431 treat image : temp/1758087628_793668_1384057860_93bc104e43056622e5a6e56ee923d059.jpg resize: (1080, 1920) 1384057860 9.563839021488473 treat image : temp/1758087628_793668_1384057835_8f62341bd2e29be1c856b2334ae43653.jpg resize: (1080, 1920) 1384057835 8.906063237409409 treat image : temp/1758087628_793668_1384035797_4ce15a12f6e8678d9c0f77b7ff098217.jpg resize: (1080, 1920) 1384035797 9.564032403560505 treat image : temp/1758087628_793668_1384035700_4e1cea65bc13392ea825dc4690e03a37.jpg resize: (1080, 1920) 1384035700 9.311859024124445 treat image : temp/1758087628_793668_1384035684_53278231a81aa4c91e32b56c942be777.jpg resize: (1080, 1920) 1384035684 9.695635329509678 treat image : temp/1758087628_793668_1384035670_f14067bb734e4a4622be03ea79d52601.jpg resize: (1080, 1920) 1384035670 10.166897587798653 treat image : temp/1758087628_793668_1384035662_807505554e063ae7e1d4d34a097856f5.jpg resize: (1080, 1920) 1384035662 9.78693389572883 treat image : temp/1758087628_793668_1384035618_85b09176feaa680887f7f57075b76f07.jpg resize: (1080, 1920) 1384035618 9.908358479992222 treat image : temp/1758087628_793668_1384035611_ff0fbfad23cba361c5fae4f7c80ea35e.jpg resize: (1080, 1920) 1384035611 9.493734997523175 treat image : temp/1758087628_793668_1384035604_44955f30f02e2ab22a17439579a8991e.jpg resize: (1080, 1920) 1384035604 10.169058516661492 treat image : temp/1758087628_793668_1384035596_1a6437b03966fbb3e67679714a4e3e0d.jpg resize: (1080, 1920) 1384035596 9.817866481135907 treat image : temp/1758087628_793668_1384035574_8dcf397f0b796f6a7f6f51ac28474e9c.jpg resize: (1080, 1920) 1384035574 9.476841353013874 treat image : temp/1758087628_793668_1384035556_5cc60204395bcb6c3589290918e88f46.jpg resize: (1080, 1920) 1384035556 9.478279561222688 treat image : temp/1758087628_793668_1384035551_6bca316f3de7e0d0a6631cde480122b7.jpg resize: (1080, 1920) 1384035551 9.41231276161031 treat image : temp/1758087628_793668_1384035524_719db6b140e31749106225b70ded0812.jpg resize: (1080, 1920) 1384035524 9.791204719089354 treat image : temp/1758087628_793668_1384035502_e85bfee361e4a56d75e8aa1825fe7c29.jpg resize: (1080, 1920) 1384035502 9.846606869484173 treat image : temp/1758087628_793668_1384035454_58cd9cefdce7da53c8ee2ba8cfb0e8d9.jpg resize: (1080, 1920) 1384035454 10.108940861109003 treat image : temp/1758087628_793668_1384035431_87305e495b10d5db75a381dc10fe673d.jpg resize: (1080, 1920) 1384035431 9.571915428268293 treat image : temp/1758087628_793668_1384035380_17a868f271159d397e1138c00111778b.jpg resize: (1080, 1920) 1384035380 9.97695809539519 treat image : temp/1758087628_793668_1384035374_53e8cc05a3474a382d8da8b94982d49c.jpg resize: (1080, 1920) 1384035374 9.699919559610228 treat image : temp/1758087628_793668_1384035348_085e3ff3264be5ae843d61577bbd7671.jpg resize: (1080, 1920) 1384035348 10.208162332993524 treat image : temp/1758087628_793668_1384035342_ff9001ff933ef86e1db96a3d4a260fb1.jpg resize: (1080, 1920) 1384035342 9.743846977388996 treat image : temp/1758087628_793668_1384035326_c5f7ac56cb11c425066c88f6ee3814b4.jpg resize: (1080, 1920) 1384035326 9.83565971156901 treat image : temp/1758087628_793668_1384035301_d8c4e5e54a73e684ab69d628557e9b8d.jpg resize: (1080, 1920) 1384035301 9.554765877200742 treat image : temp/1758087628_793668_1384035267_3f24813cc166cdcbf16e604cb9b11318.jpg resize: (1080, 1920) 1384035267 10.258988024381976 treat image : temp/1758087628_793668_1384035249_f0966d3b78221da22a7f54298d461f3a.jpg resize: (1080, 1920) 1384035249 9.781120826584292 treat image : temp/1758087628_793668_1384035235_8e97fffce03ff83438de3716fbbc4cf1.jpg resize: (1080, 1920) 1384035235 9.422251626446029 treat image : temp/1758087628_793668_1384035213_6b5d07364a203066e1b02a34235df43d.jpg resize: (1080, 1920) 1384035213 10.284115961124488 treat image : temp/1758087628_793668_1384035202_d75c999d9920dd572e43bd4a3a12b58b.jpg resize: (1080, 1920) 1384035202 9.705590039415709 treat image : temp/1758087628_793668_1384035152_c888d84a507c9d5ab19e480509a20483.jpg resize: (1080, 1920) 1384035152 9.988816653486944 treat image : temp/1758087628_793668_1384035136_63a63c968c35a71eb2d035d8329b0843.jpg resize: (1080, 1920) 1384035136 10.001050397110381 treat image : temp/1758087628_793668_1384035090_1f54e7323fb7b03885820d2d483b4593.jpg resize: (1080, 1920) 1384035090 9.963473494470904 treat image : temp/1758087628_793668_1384035056_8fedc7847b3b3223540459eadc1c9a28.jpg resize: (1080, 1920) 1384035056 9.168711664382872 treat image : temp/1758087628_793668_1384035032_ccd933fcf1053dc917bc5bab224ccd67.jpg resize: (1080, 1920) 1384035032 10.248087858373614 treat image : temp/1758087628_793668_1384035010_0d96b5f2fb9a1756128e8dc961befb6f.jpg resize: (1080, 1920) 1384035010 10.482818899779526 treat image : temp/1758087628_793668_1384034996_cc62b8deba09f8a299733e8a28faf36b.jpg resize: (1080, 1920) 1384034996 9.685675785315608 treat image : temp/1758087628_793668_1384034946_f0f87fe57e86d340eaf1953e3a32f77d.jpg resize: (1080, 1920) 1384034946 9.580744397499407 treat image : temp/1758087628_793668_1384034896_0e1f5d25aad705b0ea8be0ce27aedae5.jpg resize: (1080, 1920) 1384034896 9.543586876404829 treat image : temp/1758087628_793668_1384034736_f190cf8badef2bf19b31d701500f5136.jpg resize: (1080, 1920) 1384034736 9.524226754586667 treat image : temp/1758087628_793668_1384035797_4ce15a12f6e8678d9c0f77b7ff098217_rle_crop_3960511978_0.png resize: (998, 1473) 1384064619 0.18451511152271058 treat image : temp/1758087628_793668_1384035797_4ce15a12f6e8678d9c0f77b7ff098217_rle_crop_3960513014_0.png resize: (998, 1473) 1384064621 0.18451511152271058 treat image : temp/1758087628_793668_1384035797_4ce15a12f6e8678d9c0f77b7ff098217_rle_crop_3960532270_0.png resize: (998, 1470) 1384064622 0.1936672649646077 treat image : temp/1758087628_793668_1384035670_f14067bb734e4a4622be03ea79d52601_rle_crop_3960511980_0.png resize: (1003, 1490) 1384064623 0.18119558803284777 treat image : temp/1758087628_793668_1384035670_f14067bb734e4a4622be03ea79d52601_rle_crop_3960513029_0.png resize: (1003, 1490) 1384064624 0.18119558803284777 treat image : temp/1758087628_793668_1384035670_f14067bb734e4a4622be03ea79d52601_rle_crop_3960532271_0.png resize: (1003, 1475) 1384064625 0.18607167924532253 treat image : temp/1758087628_793668_1384035618_85b09176feaa680887f7f57075b76f07_rle_crop_3960511981_0.png resize: (967, 799) 1384064626 2.012570095502887 treat image : temp/1758087628_793668_1384035618_85b09176feaa680887f7f57075b76f07_rle_crop_3960513031_0.png resize: (967, 799) 1384064627 2.012570095502887 treat image : temp/1758087628_793668_1384035596_1a6437b03966fbb3e67679714a4e3e0d_rle_crop_3960511982_0.png resize: (1005, 1463) 1384064628 0.2807828396346203 treat image : temp/1758087628_793668_1384035596_1a6437b03966fbb3e67679714a4e3e0d_rle_crop_3960513054_0.png resize: (1005, 1463) 1384064631 0.2807828396346203 treat image : temp/1758087628_793668_1384035596_1a6437b03966fbb3e67679714a4e3e0d_rle_crop_3960532273_0.png resize: (989, 1338) 1384064632 0.08998416054846145 treat image : temp/1758087628_793668_1384035551_6bca316f3de7e0d0a6631cde480122b7_rle_crop_3960511983_0.png resize: (996, 1476) 1384064633 -0.17230786596522335 treat image : temp/1758087628_793668_1384035551_6bca316f3de7e0d0a6631cde480122b7_rle_crop_3960513056_0.png resize: (996, 1476) 1384064634 -0.17230786596522335 treat image : temp/1758087628_793668_1384035551_6bca316f3de7e0d0a6631cde480122b7_rle_crop_3960532274_0.png resize: (996, 1479) 1384064635 -0.16220217707894155 treat image : temp/1758087628_793668_1384035524_719db6b140e31749106225b70ded0812_rle_crop_3960511984_0.png resize: (270, 243) 1384064636 -1.0194815669774395 treat image : temp/1758087628_793668_1384035524_719db6b140e31749106225b70ded0812_rle_crop_3960513058_0.png resize: (270, 243) 1384064637 -1.0194815669774395 treat image : temp/1758087628_793668_1384035502_e85bfee361e4a56d75e8aa1825fe7c29_rle_crop_3960511985_0.png resize: (1008, 1436) 1384064638 -0.16147378176228744 treat image : temp/1758087628_793668_1384035502_e85bfee361e4a56d75e8aa1825fe7c29_rle_crop_3960513060_0.png resize: (1008, 1436) 1384064639 -0.16147378176228744 treat image : temp/1758087628_793668_1384035326_c5f7ac56cb11c425066c88f6ee3814b4_rle_crop_3960511986_0.png resize: (997, 1456) 1384064640 0.2952497353388084 treat image : temp/1758087628_793668_1384035326_c5f7ac56cb11c425066c88f6ee3814b4_rle_crop_3960513062_0.png resize: (997, 1456) 1384064641 0.2952497353388084 treat image : temp/1758087628_793668_1384035090_1f54e7323fb7b03885820d2d483b4593_rle_crop_3960511987_0.png resize: (996, 1446) 1384064642 -0.33945997254921934 treat image : temp/1758087628_793668_1384035090_1f54e7323fb7b03885820d2d483b4593_rle_crop_3960513064_0.png resize: (996, 1446) 1384064643 -0.33945997254921934 treat image : temp/1758087628_793668_1384035032_ccd933fcf1053dc917bc5bab224ccd67_rle_crop_3960532276_0.png resize: (993, 1491) 1384064644 -0.07964341568823483 treat image : temp/1758087628_793668_1384034736_f190cf8badef2bf19b31d701500f5136_rle_crop_3960532278_0.png resize: (1000, 1471) 1384064646 -0.12036605920945917 treat image : temp/1758087628_793668_1384057886_5ce533631014cf169f3234a672851180_rle_crop_3960532268_0.png resize: (485, 380) 1384064673 -0.08707542496473612 treat image : temp/1758087628_793668_1384057860_93bc104e43056622e5a6e56ee923d059_rle_crop_3960532269_0.png resize: (994, 1569) 1384064674 1.272534363628632 treat image : temp/1758087628_793668_1384035684_53278231a81aa4c91e32b56c942be777_rle_crop_3960511979_0.png resize: (259, 122) 1384064679 -1.0500144560739053 treat image : temp/1758087628_793668_1384035684_53278231a81aa4c91e32b56c942be777_rle_crop_3960513016_0.png resize: (259, 122) 1384064680 -1.0500144560739053 treat image : temp/1758087628_793668_1384035670_f14067bb734e4a4622be03ea79d52601_rle_crop_3960532272_0.png resize: (466, 285) 1384064681 0.3509680472711165 treat image : temp/1758087628_793668_1384035152_c888d84a507c9d5ab19e480509a20483_rle_crop_3960532275_0.png resize: (460, 292) 1384064682 0.4317325042488964 treat image : temp/1758087628_793668_1384034946_f0f87fe57e86d340eaf1953e3a32f77d_rle_crop_3960532277_0.png resize: (466, 287) 1384064684 0.41667150259152164 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 71 time used for this insertion : 0.02275681495666504 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 71 time used for this insertion : 0.16690945625305176 save missing photos in datou_result : time spend for datou_step_exec : 44.503785610198975 time spend to save output : 0.19443845748901367 total time spend for step 6 : 44.69822406768799 step7:brightness Wed Sep 17 07:43:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1758087628_793668_1384057886_5ce533631014cf169f3234a672851180.jpg treat image : temp/1758087628_793668_1384057860_93bc104e43056622e5a6e56ee923d059.jpg treat image : temp/1758087628_793668_1384057835_8f62341bd2e29be1c856b2334ae43653.jpg treat image : temp/1758087628_793668_1384035797_4ce15a12f6e8678d9c0f77b7ff098217.jpg treat image : temp/1758087628_793668_1384035700_4e1cea65bc13392ea825dc4690e03a37.jpg treat image : temp/1758087628_793668_1384035684_53278231a81aa4c91e32b56c942be777.jpg treat image : temp/1758087628_793668_1384035670_f14067bb734e4a4622be03ea79d52601.jpg treat image : temp/1758087628_793668_1384035662_807505554e063ae7e1d4d34a097856f5.jpg treat image : temp/1758087628_793668_1384035618_85b09176feaa680887f7f57075b76f07.jpg treat image : temp/1758087628_793668_1384035611_ff0fbfad23cba361c5fae4f7c80ea35e.jpg treat image : temp/1758087628_793668_1384035604_44955f30f02e2ab22a17439579a8991e.jpg treat image : temp/1758087628_793668_1384035596_1a6437b03966fbb3e67679714a4e3e0d.jpg treat image : temp/1758087628_793668_1384035574_8dcf397f0b796f6a7f6f51ac28474e9c.jpg treat image : temp/1758087628_793668_1384035556_5cc60204395bcb6c3589290918e88f46.jpg treat image : temp/1758087628_793668_1384035551_6bca316f3de7e0d0a6631cde480122b7.jpg treat image : temp/1758087628_793668_1384035524_719db6b140e31749106225b70ded0812.jpg treat image : temp/1758087628_793668_1384035502_e85bfee361e4a56d75e8aa1825fe7c29.jpg treat image : temp/1758087628_793668_1384035454_58cd9cefdce7da53c8ee2ba8cfb0e8d9.jpg treat image : temp/1758087628_793668_1384035431_87305e495b10d5db75a381dc10fe673d.jpg treat image : temp/1758087628_793668_1384035380_17a868f271159d397e1138c00111778b.jpg treat image : temp/1758087628_793668_1384035374_53e8cc05a3474a382d8da8b94982d49c.jpg treat image : temp/1758087628_793668_1384035348_085e3ff3264be5ae843d61577bbd7671.jpg treat image : temp/1758087628_793668_1384035342_ff9001ff933ef86e1db96a3d4a260fb1.jpg treat image : temp/1758087628_793668_1384035326_c5f7ac56cb11c425066c88f6ee3814b4.jpg treat image : temp/1758087628_793668_1384035301_d8c4e5e54a73e684ab69d628557e9b8d.jpg treat image : temp/1758087628_793668_1384035267_3f24813cc166cdcbf16e604cb9b11318.jpg treat image : temp/1758087628_793668_1384035249_f0966d3b78221da22a7f54298d461f3a.jpg treat image : temp/1758087628_793668_1384035235_8e97fffce03ff83438de3716fbbc4cf1.jpg treat image : temp/1758087628_793668_1384035213_6b5d07364a203066e1b02a34235df43d.jpg treat image : temp/1758087628_793668_1384035202_d75c999d9920dd572e43bd4a3a12b58b.jpg treat image : temp/1758087628_793668_1384035152_c888d84a507c9d5ab19e480509a20483.jpg treat image : temp/1758087628_793668_1384035136_63a63c968c35a71eb2d035d8329b0843.jpg treat image : temp/1758087628_793668_1384035090_1f54e7323fb7b03885820d2d483b4593.jpg treat image : temp/1758087628_793668_1384035056_8fedc7847b3b3223540459eadc1c9a28.jpg treat image : temp/1758087628_793668_1384035032_ccd933fcf1053dc917bc5bab224ccd67.jpg treat image : temp/1758087628_793668_1384035010_0d96b5f2fb9a1756128e8dc961befb6f.jpg treat image : temp/1758087628_793668_1384034996_cc62b8deba09f8a299733e8a28faf36b.jpg treat image : temp/1758087628_793668_1384034946_f0f87fe57e86d340eaf1953e3a32f77d.jpg treat image : temp/1758087628_793668_1384034896_0e1f5d25aad705b0ea8be0ce27aedae5.jpg treat image : temp/1758087628_793668_1384034736_f190cf8badef2bf19b31d701500f5136.jpg treat image : temp/1758087628_793668_1384035797_4ce15a12f6e8678d9c0f77b7ff098217_rle_crop_3960511978_0.png treat image : temp/1758087628_793668_1384035797_4ce15a12f6e8678d9c0f77b7ff098217_rle_crop_3960513014_0.png treat image : temp/1758087628_793668_1384035797_4ce15a12f6e8678d9c0f77b7ff098217_rle_crop_3960532270_0.png treat image : temp/1758087628_793668_1384035670_f14067bb734e4a4622be03ea79d52601_rle_crop_3960511980_0.png treat image : temp/1758087628_793668_1384035670_f14067bb734e4a4622be03ea79d52601_rle_crop_3960513029_0.png treat image : temp/1758087628_793668_1384035670_f14067bb734e4a4622be03ea79d52601_rle_crop_3960532271_0.png treat image : temp/1758087628_793668_1384035618_85b09176feaa680887f7f57075b76f07_rle_crop_3960511981_0.png treat image : temp/1758087628_793668_1384035618_85b09176feaa680887f7f57075b76f07_rle_crop_3960513031_0.png treat image : temp/1758087628_793668_1384035596_1a6437b03966fbb3e67679714a4e3e0d_rle_crop_3960511982_0.png treat image : temp/1758087628_793668_1384035596_1a6437b03966fbb3e67679714a4e3e0d_rle_crop_3960513054_0.png treat image : temp/1758087628_793668_1384035596_1a6437b03966fbb3e67679714a4e3e0d_rle_crop_3960532273_0.png treat image : temp/1758087628_793668_1384035551_6bca316f3de7e0d0a6631cde480122b7_rle_crop_3960511983_0.png treat image : temp/1758087628_793668_1384035551_6bca316f3de7e0d0a6631cde480122b7_rle_crop_3960513056_0.png treat image : temp/1758087628_793668_1384035551_6bca316f3de7e0d0a6631cde480122b7_rle_crop_3960532274_0.png treat image : temp/1758087628_793668_1384035524_719db6b140e31749106225b70ded0812_rle_crop_3960511984_0.png treat image : temp/1758087628_793668_1384035524_719db6b140e31749106225b70ded0812_rle_crop_3960513058_0.png treat image : temp/1758087628_793668_1384035502_e85bfee361e4a56d75e8aa1825fe7c29_rle_crop_3960511985_0.png treat image : temp/1758087628_793668_1384035502_e85bfee361e4a56d75e8aa1825fe7c29_rle_crop_3960513060_0.png treat image : temp/1758087628_793668_1384035326_c5f7ac56cb11c425066c88f6ee3814b4_rle_crop_3960511986_0.png treat image : temp/1758087628_793668_1384035326_c5f7ac56cb11c425066c88f6ee3814b4_rle_crop_3960513062_0.png treat image : temp/1758087628_793668_1384035090_1f54e7323fb7b03885820d2d483b4593_rle_crop_3960511987_0.png treat image : temp/1758087628_793668_1384035090_1f54e7323fb7b03885820d2d483b4593_rle_crop_3960513064_0.png treat image : temp/1758087628_793668_1384035032_ccd933fcf1053dc917bc5bab224ccd67_rle_crop_3960532276_0.png treat image : temp/1758087628_793668_1384034736_f190cf8badef2bf19b31d701500f5136_rle_crop_3960532278_0.png treat image : temp/1758087628_793668_1384057886_5ce533631014cf169f3234a672851180_rle_crop_3960532268_0.png treat image : temp/1758087628_793668_1384057860_93bc104e43056622e5a6e56ee923d059_rle_crop_3960532269_0.png treat image : temp/1758087628_793668_1384035684_53278231a81aa4c91e32b56c942be777_rle_crop_3960511979_0.png treat image : temp/1758087628_793668_1384035684_53278231a81aa4c91e32b56c942be777_rle_crop_3960513016_0.png treat image : temp/1758087628_793668_1384035670_f14067bb734e4a4622be03ea79d52601_rle_crop_3960532272_0.png treat image : temp/1758087628_793668_1384035152_c888d84a507c9d5ab19e480509a20483_rle_crop_3960532275_0.png treat image : temp/1758087628_793668_1384034946_f0f87fe57e86d340eaf1953e3a32f77d_rle_crop_3960532277_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 71 time used for this insertion : 0.01803278923034668 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 71 time used for this insertion : 0.024813175201416016 save missing photos in datou_result : time spend for datou_step_exec : 12.665218830108643 time spend to save output : 0.047477006912231445 total time spend for step 7 : 12.712695837020874 step8:velours_tree Wed Sep 17 07:44:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.08815813064575195 time spend to save output : 5.269050598144531e-05 total time spend for step 8 : 0.0882108211517334 step9:send_mail_cod Wed Sep 17 07:44:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26929261_17-09-2025_07_44_11.pdf 26929423 imagette269294231758087851 26929424 change filename to text .imagette269294241758087851 26929425 imagette269294251758087851 26929426 imagette269294261758087851 26929427 imagette269294271758087851 26929428 imagette269294281758087851 26929430 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette269294301758087851 26929431 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette269294311758087852 26929432 change filename to text .change filename to text .imagette269294321758087854 26929433 imagette269294331758087854 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26929261 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26929423,26929424,26929425,26929426,26929427,26929428,26929429,26929430,26929431,26929432,26929433?tags=flou,carton,pehd,metal,background,mal_croppe,environnement,autre,papier,pet_clair,pet_fonce args[1384057886] : ((1384057886, 9.912492783384431, 492688767), (1384057886, 0.26008429584867115, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384057860] : ((1384057860, 9.563839021488473, 492688767), (1384057860, 0.38253348836156637, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384057835] : ((1384057835, 8.906063237409409, 492688767), (1384057835, 0.403054659119048, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035797] : ((1384035797, 9.564032403560505, 492688767), (1384035797, 0.3820492746334207, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035700] : ((1384035700, 9.311859024124445, 492688767), (1384035700, 0.38124371996194967, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035684] : ((1384035684, 9.695635329509678, 492688767), (1384035684, 0.38147166205340965, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035670] : ((1384035670, 10.166897587798653, 492688767), (1384035670, 0.38213643213872583, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035662] : ((1384035662, 9.78693389572883, 492688767), (1384035662, 0.38182971488164597, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035618] : ((1384035618, 9.908358479992222, 492688767), (1384035618, 0.381855700774234, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035611] : ((1384035611, 9.493734997523175, 492688767), (1384035611, 0.3833400596046415, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035604] : ((1384035604, 10.169058516661492, 492688767), (1384035604, 0.381808617392264, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035596] : ((1384035596, 9.817866481135907, 492688767), (1384035596, 0.3816129228575307, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035574] : ((1384035574, 9.476841353013874, 492688767), (1384035574, 0.3823741689338721, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035556] : ((1384035556, 9.478279561222688, 492688767), (1384035556, 0.38224498595323253, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035551] : ((1384035551, 9.41231276161031, 492688767), (1384035551, 0.3826815667902163, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035524] : ((1384035524, 9.791204719089354, 492688767), (1384035524, 0.3827380143547396, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035502] : ((1384035502, 9.846606869484173, 492688767), (1384035502, 0.38257139570314624, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035454] : ((1384035454, 10.108940861109003, 492688767), (1384035454, 0.3827984013255919, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035431] : ((1384035431, 9.571915428268293, 492688767), (1384035431, 0.38223840916197804, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035380] : ((1384035380, 9.97695809539519, 492688767), (1384035380, 0.3817556509723363, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035374] : ((1384035374, 9.699919559610228, 492688767), (1384035374, 0.38074621850102375, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035348] : ((1384035348, 10.208162332993524, 492688767), (1384035348, 0.38165274929145443, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035342] : ((1384035342, 9.743846977388996, 492688767), (1384035342, 0.3830689194871272, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035326] : ((1384035326, 9.83565971156901, 492688767), (1384035326, 0.3819075686946603, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035301] : ((1384035301, 9.554765877200742, 492688767), (1384035301, 0.38104961516168173, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035267] : ((1384035267, 10.258988024381976, 492688767), (1384035267, 0.3811697569305401, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035249] : ((1384035249, 9.781120826584292, 492688767), (1384035249, 0.3814946141952356, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035235] : ((1384035235, 9.422251626446029, 492688767), (1384035235, 0.3819098773275355, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035213] : ((1384035213, 10.284115961124488, 492688767), (1384035213, 0.3805312801121877, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035202] : ((1384035202, 9.705590039415709, 492688767), (1384035202, 0.38216075261526894, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035152] : ((1384035152, 9.988816653486944, 492688767), (1384035152, 0.382221224093818, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035136] : ((1384035136, 10.001050397110381, 492688767), (1384035136, 0.381132122979529, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035090] : ((1384035090, 9.963473494470904, 492688767), (1384035090, 0.38164994224705867, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035056] : ((1384035056, 9.168711664382872, 492688767), (1384035056, 0.38134593735702, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035032] : ((1384035032, 10.248087858373614, 492688767), (1384035032, 0.3818527361872076, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384035010] : ((1384035010, 10.482818899779526, 492688767), (1384035010, 0.38040702208735533, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384034996] : ((1384034996, 9.685675785315608, 492688767), (1384034996, 0.3796014292786274, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384034946] : ((1384034946, 9.580744397499407, 492688767), (1384034946, 0.3812827260430335, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384034896] : ((1384034896, 9.543586876404829, 492688767), (1384034896, 0.38049601493593466, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com args[1384034736] : ((1384034736, 9.524226754586667, 492688767), (1384034736, 0.38288916726619, 2107752395), '0.07683520518975764') We are sending mail with results at report@fotonower.com refus_total : 0.07683520518975764 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26929261 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26929261_17-09-2025_07_44_11.pdf results_Auto_P26929261_17-09-2025_07_44_11.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26929261_17-09-2025_07_44_11.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26929261','results_Auto_P26929261_17-09-2025_07_44_11.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26929261_17-09-2025_07_44_11.pdf','pdf','','1.3','0.07683520518975764') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26929261

https://www.fotonower.com/image?json=false&list_photos_id=1384057886
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.912492783384431)
https://www.fotonower.com/image?json=false&list_photos_id=1384057860
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.563839021488473)
https://www.fotonower.com/image?json=false&list_photos_id=1384057835
La photo est trop floue, merci de reprendre une photo.(avec le score = 8.906063237409409)
https://www.fotonower.com/image?json=false&list_photos_id=1384035797
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.564032403560505)
https://www.fotonower.com/image?json=false&list_photos_id=1384035700
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.311859024124445)
https://www.fotonower.com/image?json=false&list_photos_id=1384035684
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.695635329509678)
https://www.fotonower.com/image?json=false&list_photos_id=1384035670
La photo est trop floue, merci de reprendre une photo.(avec le score = 10.166897587798653)
https://www.fotonower.com/image?json=false&list_photos_id=1384035662
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.78693389572883)
https://www.fotonower.com/image?json=false&list_photos_id=1384035618
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.908358479992222)
https://www.fotonower.com/image?json=false&list_photos_id=1384035611
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.493734997523175)
https://www.fotonower.com/image?json=false&list_photos_id=1384035604
La photo est trop floue, merci de reprendre une photo.(avec le score = 10.169058516661492)
https://www.fotonower.com/image?json=false&list_photos_id=1384035596
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.817866481135907)
https://www.fotonower.com/image?json=false&list_photos_id=1384035574
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.476841353013874)
https://www.fotonower.com/image?json=false&list_photos_id=1384035556
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.478279561222688)
https://www.fotonower.com/image?json=false&list_photos_id=1384035551
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.41231276161031)
https://www.fotonower.com/image?json=false&list_photos_id=1384035524
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.791204719089354)
https://www.fotonower.com/image?json=false&list_photos_id=1384035502
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.846606869484173)
https://www.fotonower.com/image?json=false&list_photos_id=1384035454
La photo est trop floue, merci de reprendre une photo.(avec le score = 10.108940861109003)
https://www.fotonower.com/image?json=false&list_photos_id=1384035431
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.571915428268293)
https://www.fotonower.com/image?json=false&list_photos_id=1384035380
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.97695809539519)
https://www.fotonower.com/image?json=false&list_photos_id=1384035374
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.699919559610228)
https://www.fotonower.com/image?json=false&list_photos_id=1384035348
La photo est trop floue, merci de reprendre une photo.(avec le score = 10.208162332993524)
https://www.fotonower.com/image?json=false&list_photos_id=1384035342
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.743846977388996)
https://www.fotonower.com/image?json=false&list_photos_id=1384035326
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.83565971156901)
https://www.fotonower.com/image?json=false&list_photos_id=1384035301
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.554765877200742)
https://www.fotonower.com/image?json=false&list_photos_id=1384035267
La photo est trop floue, merci de reprendre une photo.(avec le score = 10.258988024381976)
https://www.fotonower.com/image?json=false&list_photos_id=1384035249
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.781120826584292)
https://www.fotonower.com/image?json=false&list_photos_id=1384035235
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.422251626446029)
https://www.fotonower.com/image?json=false&list_photos_id=1384035213
La photo est trop floue, merci de reprendre une photo.(avec le score = 10.284115961124488)
https://www.fotonower.com/image?json=false&list_photos_id=1384035202
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.705590039415709)
https://www.fotonower.com/image?json=false&list_photos_id=1384035152
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.988816653486944)
https://www.fotonower.com/image?json=false&list_photos_id=1384035136
La photo est trop floue, merci de reprendre une photo.(avec le score = 10.001050397110381)
https://www.fotonower.com/image?json=false&list_photos_id=1384035090
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.963473494470904)
https://www.fotonower.com/image?json=false&list_photos_id=1384035056
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.168711664382872)
https://www.fotonower.com/image?json=false&list_photos_id=1384035032
La photo est trop floue, merci de reprendre une photo.(avec le score = 10.248087858373614)
https://www.fotonower.com/image?json=false&list_photos_id=1384035010
La photo est trop floue, merci de reprendre une photo.(avec le score = 10.482818899779526)
https://www.fotonower.com/image?json=false&list_photos_id=1384034996
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.685675785315608)
https://www.fotonower.com/image?json=false&list_photos_id=1384034946
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.580744397499407)
https://www.fotonower.com/image?json=false&list_photos_id=1384034896
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.543586876404829)
https://www.fotonower.com/image?json=false&list_photos_id=1384034736
La photo est trop floue, merci de reprendre une photo.(avec le score = 9.524226754586667)

Dans ces conditions,le taux de refus est: 7.68%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/26929424?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26929430?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26929431?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26929432?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26929261_17-09-2025_07_44_11.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26929423,26929424,26929425,26929426,26929427,26929428,26929429,26929430,26929431,26929432,26929433?tags=flou,carton,pehd,metal,background,mal_croppe,environnement,autre,papier,pet_clair,pet_fonce.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 17 Sep 2025 05:44:18 GMT Content-Length: 0 Connection: close X-Message-Id: 4XacQWotToGf_v2ZZOGdUg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1384057886, 1384057860, 1384057835, 1384035797, 1384035700, 1384035684, 1384035670, 1384035662, 1384035618, 1384035611, 1384035604, 1384035596, 1384035574, 1384035556, 1384035551, 1384035524, 1384035502, 1384035454, 1384035431, 1384035380, 1384035374, 1384035348, 1384035342, 1384035326, 1384035301, 1384035267, 1384035249, 1384035235, 1384035213, 1384035202, 1384035152, 1384035136, 1384035090, 1384035056, 1384035032, 1384035010, 1384034996, 1384034946, 1384034896, 1384034736] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384057886', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384057860', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384057835', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035797', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035700', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035684', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035670', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035662', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035618', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035611', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035604', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035596', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035574', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035556', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035551', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035524', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035502', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035454', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035431', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035380', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035374', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035348', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035342', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035326', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035301', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035267', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035249', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035235', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035213', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035202', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035152', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035136', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035090', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035056', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035032', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035010', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034996', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034946', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034896', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034736', None, None, None, None, None, '3733246') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 40 time used for this insertion : 0.2552938461303711 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.4286534786224365 time spend to save output : 0.25585103034973145 total time spend for step 9 : 7.684504508972168 step10:split_time_score Wed Sep 17 07:44:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('00', 43), ('01', 68), ('06', 3)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 17092025 26929261 Nombre de photos uploadées : 114 / 23040 (0%) 17092025 26929261 Nombre de photos taguées (types de déchets): 0 / 114 (0%) 17092025 26929261 Nombre de photos taguées (volume) : 0 / 114 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 4.291534423828125e-06 ?????????????????????????????????????????????????????????????????????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0062100887298583984 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.21820855140686035 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.07683520518975764 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26929261_17-09-2025_07_44_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26929261 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26929261 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'17092025': {'nb_upload': 114, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1384057886, 1384057860, 1384057835, 1384035797, 1384035700, 1384035684, 1384035670, 1384035662, 1384035618, 1384035611, 1384035604, 1384035596, 1384035574, 1384035556, 1384035551, 1384035524, 1384035502, 1384035454, 1384035431, 1384035380, 1384035374, 1384035348, 1384035342, 1384035326, 1384035301, 1384035267, 1384035249, 1384035235, 1384035213, 1384035202, 1384035152, 1384035136, 1384035090, 1384035056, 1384035032, 1384035010, 1384034996, 1384034946, 1384034896, 1384034736] Looping around the photos to save general results len do output : 1 /26929261Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384057886', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384057860', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384057835', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035797', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035700', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035684', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035670', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035662', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035618', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035611', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035604', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035596', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035574', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035556', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035551', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035524', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035502', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035454', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035431', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035380', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035374', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035348', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035342', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035326', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035301', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035267', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035249', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035235', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035213', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035202', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035152', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035136', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035090', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035056', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035032', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384035010', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034996', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034946', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034896', None, None, None, None, None, '3733246') ('3318', None, None, None, None, None, None, None, '3733246') ('3318', '26929261', '1384034736', None, None, None, None, None, '3733246') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 41 time used for this insertion : 0.2746138572692871 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.4699890613555908 time spend to save output : 0.2751166820526123 total time spend for step 10 : 0.7451057434082031 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 182.23user 35.77system 3:55.62elapsed 92%CPU (0avgtext+0avgdata 3064936maxresident)k 579840inputs+101368outputs (4126major+2690837minor)pagefaults 0swaps