python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1116062 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3630167'] with mtr_portfolio_ids : ['26311682'] and first list_photo_ids : [] new path : /proc/1116062/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 18 ; length of list_pids : 18 ; length of list_args : 18 time to download the photos : 2.608384370803833 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Aug 29 00:50:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10381 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-29 00:50:35.734311: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-29 00:50:35.760564: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-29 00:50:35.762812: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fe50c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-29 00:50:35.762870: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-29 00:50:35.766802: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-29 00:50:35.925953: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x31379a20 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-29 00:50:35.926024: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-29 00:50:35.927522: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-29 00:50:35.927919: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-29 00:50:35.931931: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-29 00:50:35.935213: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-29 00:50:35.936334: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-29 00:50:35.939572: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-29 00:50:35.940846: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-29 00:50:35.946738: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-29 00:50:35.948538: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-29 00:50:35.948645: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-29 00:50:35.949573: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-29 00:50:35.949591: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-29 00:50:35.949602: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-29 00:50:35.951312: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9615 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-29 00:50:36.222205: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-29 00:50:36.222292: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-29 00:50:36.222322: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-29 00:50:36.222352: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-29 00:50:36.222376: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-29 00:50:36.222394: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-29 00:50:36.222411: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-29 00:50:36.222427: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-29 00:50:36.223712: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-29 00:50:36.225039: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-29 00:50:36.225069: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-29 00:50:36.225085: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-29 00:50:36.225099: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-29 00:50:36.225113: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-29 00:50:36.225127: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-29 00:50:36.225141: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-29 00:50:36.225155: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-29 00:50:36.226456: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-29 00:50:36.226499: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-29 00:50:36.226511: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-29 00:50:36.226519: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-29 00:50:36.227851: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9615 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-29 00:50:44.572660: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-29 00:50:44.763044: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 18 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 62.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 52.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 44.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 Detection mask done ! Trying to reset tf kernel 1116448 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3977 tf kernel not reseted sub process len(results) : 18 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 18 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5500 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0005450248718261719 nb_pixel_total : 14307 time to create 1 rle with old method : 0.01636195182800293 length of segment : 64 time for calcul the mask position with numpy : 0.0005421638488769531 nb_pixel_total : 12241 time to create 1 rle with old method : 0.013317108154296875 length of segment : 218 time for calcul the mask position with numpy : 0.00045800209045410156 nb_pixel_total : 12980 time to create 1 rle with old method : 0.014437675476074219 length of segment : 160 time for calcul the mask position with numpy : 0.0003008842468261719 nb_pixel_total : 6236 time to create 1 rle with old method : 0.007249593734741211 length of segment : 153 time for calcul the mask position with numpy : 0.022745847702026367 nb_pixel_total : 784761 time to create 1 rle with new method : 0.06891036033630371 length of segment : 1032 time for calcul the mask position with numpy : 0.00040268898010253906 nb_pixel_total : 10396 time to create 1 rle with old method : 0.012192249298095703 length of segment : 175 time for calcul the mask position with numpy : 0.0004277229309082031 nb_pixel_total : 6451 time to create 1 rle with old method : 0.007983922958374023 length of segment : 119 time for calcul the mask position with numpy : 0.0003361701965332031 nb_pixel_total : 9107 time to create 1 rle with old method : 0.010856389999389648 length of segment : 143 time for calcul the mask position with numpy : 0.0010592937469482422 nb_pixel_total : 23480 time to create 1 rle with old method : 0.028462648391723633 length of segment : 288 time for calcul the mask position with numpy : 0.002382993698120117 nb_pixel_total : 94143 time to create 1 rle with old method : 0.10478448867797852 length of segment : 527 time for calcul the mask position with numpy : 0.0003573894500732422 nb_pixel_total : 14835 time to create 1 rle with old method : 0.018094539642333984 length of segment : 153 time for calcul the mask position with numpy : 0.00040078163146972656 nb_pixel_total : 6998 time to create 1 rle with old method : 0.008102178573608398 length of segment : 170 time for calcul the mask position with numpy : 0.0014235973358154297 nb_pixel_total : 50433 time to create 1 rle with old method : 0.05715203285217285 length of segment : 248 time for calcul the mask position with numpy : 0.0005793571472167969 nb_pixel_total : 18478 time to create 1 rle with old method : 0.02067852020263672 length of segment : 124 time for calcul the mask position with numpy : 0.0024878978729248047 nb_pixel_total : 104335 time to create 1 rle with old method : 0.14460468292236328 length of segment : 551 time for calcul the mask position with numpy : 0.000537872314453125 nb_pixel_total : 8042 time to create 1 rle with old method : 0.013824939727783203 length of segment : 131 time for calcul the mask position with numpy : 0.0003848075866699219 nb_pixel_total : 4381 time to create 1 rle with old method : 0.00559234619140625 length of segment : 100 time for calcul the mask position with numpy : 0.000286102294921875 nb_pixel_total : 4828 time to create 1 rle with old method : 0.00601506233215332 length of segment : 80 time for calcul the mask position with numpy : 0.003420591354370117 nb_pixel_total : 125788 time to create 1 rle with old method : 0.14110136032104492 length of segment : 550 time for calcul the mask position with numpy : 0.00020813941955566406 nb_pixel_total : 2532 time to create 1 rle with old method : 0.003070831298828125 length of segment : 74 time for calcul the mask position with numpy : 0.0004115104675292969 nb_pixel_total : 12468 time to create 1 rle with old method : 0.014536619186401367 length of segment : 116 time for calcul the mask position with numpy : 0.00024890899658203125 nb_pixel_total : 6274 time to create 1 rle with old method : 0.0076601505279541016 length of segment : 78 time for calcul the mask position with numpy : 0.0006375312805175781 nb_pixel_total : 12364 time to create 1 rle with old method : 0.014120340347290039 length of segment : 189 time for calcul the mask position with numpy : 0.0003714561462402344 nb_pixel_total : 13879 time to create 1 rle with old method : 0.01606154441833496 length of segment : 159 time for calcul the mask position with numpy : 0.008252382278442383 nb_pixel_total : 165119 time to create 1 rle with new method : 0.01913166046142578 length of segment : 1035 time for calcul the mask position with numpy : 0.00017142295837402344 nb_pixel_total : 4181 time to create 1 rle with old method : 0.00497746467590332 length of segment : 79 time for calcul the mask position with numpy : 0.00966191291809082 nb_pixel_total : 699428 time to create 1 rle with new method : 0.018151283264160156 length of segment : 940 time for calcul the mask position with numpy : 0.0002722740173339844 nb_pixel_total : 6223 time to create 1 rle with old method : 0.0074253082275390625 length of segment : 79 time for calcul the mask position with numpy : 0.0004322528839111328 nb_pixel_total : 8350 time to create 1 rle with old method : 0.009703397750854492 length of segment : 172 time for calcul the mask position with numpy : 0.0003447532653808594 nb_pixel_total : 4946 time to create 1 rle with old method : 0.006065845489501953 length of segment : 174 time for calcul the mask position with numpy : 0.0001747608184814453 nb_pixel_total : 2757 time to create 1 rle with old method : 0.0034410953521728516 length of segment : 64 time for calcul the mask position with numpy : 0.002328157424926758 nb_pixel_total : 108691 time to create 1 rle with old method : 0.12145113945007324 length of segment : 518 time for calcul the mask position with numpy : 0.00039958953857421875 nb_pixel_total : 11034 time to create 1 rle with old method : 0.018590211868286133 length of segment : 183 time for calcul the mask position with numpy : 0.0001888275146484375 nb_pixel_total : 2970 time to create 1 rle with old method : 0.003564596176147461 length of segment : 93 time for calcul the mask position with numpy : 0.00048613548278808594 nb_pixel_total : 9012 time to create 1 rle with old method : 0.010802030563354492 length of segment : 193 time for calcul the mask position with numpy : 0.0074803829193115234 nb_pixel_total : 330421 time to create 1 rle with new method : 0.01564931869506836 length of segment : 909 time for calcul the mask position with numpy : 0.0017545223236083984 nb_pixel_total : 95354 time to create 1 rle with old method : 0.1275014877319336 length of segment : 549 time for calcul the mask position with numpy : 0.002511739730834961 nb_pixel_total : 126921 time to create 1 rle with old method : 0.1414659023284912 length of segment : 544 time for calcul the mask position with numpy : 0.0024929046630859375 nb_pixel_total : 110328 time to create 1 rle with old method : 0.12360286712646484 length of segment : 533 time for calcul the mask position with numpy : 0.00026726722717285156 nb_pixel_total : 6709 time to create 1 rle with old method : 0.008025646209716797 length of segment : 82 time for calcul the mask position with numpy : 0.0002148151397705078 nb_pixel_total : 5045 time to create 1 rle with old method : 0.0061664581298828125 length of segment : 80 time for calcul the mask position with numpy : 0.00027298927307128906 nb_pixel_total : 4511 time to create 1 rle with old method : 0.005522727966308594 length of segment : 77 time for calcul the mask position with numpy : 0.0003437995910644531 nb_pixel_total : 8540 time to create 1 rle with old method : 0.010451793670654297 length of segment : 101 time for calcul the mask position with numpy : 0.0025777816772460938 nb_pixel_total : 104956 time to create 1 rle with old method : 0.12024807929992676 length of segment : 556 time for calcul the mask position with numpy : 0.0004470348358154297 nb_pixel_total : 6946 time to create 1 rle with old method : 0.01189422607421875 length of segment : 165 time spent for convertir_results : 3.612497091293335 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 45 chid ids of type : 3594 Number RLEs to save : 12728 save missing photos in datou_result : time spend for datou_step_exec : 29.92879891395569 time spend to save output : 2.8227124214172363 total time spend for step 1 : 32.751511335372925 step2:crop_condition Fri Aug 29 00:51:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 18 ! batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 18 About to insert : list_path_to_insert length 18 new photo from crops ! About to upload 18 photos upload in portfolio : 3736932 init cache_photo without model_param we have 18 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756421467_1116062 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 18 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.623911142349243 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756421475_1116062 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.3877861499786377 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 23 About to insert : list_path_to_insert length 23 new photo from crops ! About to upload 23 photos upload in portfolio : 3736932 init cache_photo without model_param we have 23 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1756421488_1116062 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 23 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.863851547241211 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1379915897, 1379915808, 1379915793, 1379915761, 1379915739, 1379915729, 1379915720, 1379915603, 1379915600, 1379915598, 1379915596, 1379915577, 1379915574, 1379915571, 1379915563, 1379915560, 1379915454, 1379915437] Looping around the photos to save general results len do output : 45 /1380007143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1380007256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915897', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915808', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915793', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915761', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915739', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915729', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915720', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915603', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915600', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915598', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915596', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915577', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915574', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915571', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915563', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915560', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915454', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915437', None, None, None, None, None, '3630167') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 153 time used for this insertion : 0.0289919376373291 save_final save missing photos in datou_result : time spend for datou_step_exec : 31.877946615219116 time spend to save output : 0.030536890029907227 total time spend for step 2 : 31.908483505249023 step3:rle_unique_nms_with_priority Fri Aug 29 00:51:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.8070156574249268 time for calcul the mask position with numpy : 0.26884961128234863 nb_pixel_total : 1249590 time to create 1 rle with new method : 0.13227033615112305 time for calcul the mask position with numpy : 0.01199793815612793 nb_pixel_total : 778512 time to create 1 rle with new method : 0.07353973388671875 time for calcul the mask position with numpy : 0.006560087203979492 nb_pixel_total : 5970 time to create 1 rle with old method : 0.006508350372314453 time for calcul the mask position with numpy : 0.006166934967041016 nb_pixel_total : 12980 time to create 1 rle with old method : 0.014286994934082031 time for calcul the mask position with numpy : 0.006456613540649414 nb_pixel_total : 12241 time to create 1 rle with old method : 0.013526201248168945 time for calcul the mask position with numpy : 0.006381511688232422 nb_pixel_total : 14307 time to create 1 rle with old method : 0.015749454498291016 create new chi : 0.5793230533599854 time to delete rle : 0.029493093490600586 batch 1 Loaded 11 chid ids of type : 3594 ++++++++Number RLEs to save : 4283 TO DO : save crop sub photo not yet done ! save time : 0.757559061050415 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.059598684310913086 time for calcul the mask position with numpy : 0.18389177322387695 nb_pixel_total : 2063204 time to create 1 rle with new method : 0.05390644073486328 time for calcul the mask position with numpy : 0.006716012954711914 nb_pixel_total : 10396 time to create 1 rle with old method : 0.01174473762512207 create new chi : 0.2565271854400635 time to delete rle : 0.0002300739288330078 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1430 TO DO : save crop sub photo not yet done ! save time : 0.7612676620483398 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.05456948280334473 time for calcul the mask position with numpy : 0.034288883209228516 nb_pixel_total : 2058042 time to create 1 rle with new method : 0.11174249649047852 time for calcul the mask position with numpy : 0.01240992546081543 nb_pixel_total : 9107 time to create 1 rle with old method : 0.010145187377929688 time for calcul the mask position with numpy : 0.011796712875366211 nb_pixel_total : 6451 time to create 1 rle with old method : 0.008687496185302734 create new chi : 0.19816923141479492 time to delete rle : 0.0004227161407470703 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1604 TO DO : save crop sub photo not yet done ! save time : 0.26023125648498535 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.08807826042175293 time for calcul the mask position with numpy : 0.05572199821472168 nb_pixel_total : 1941142 time to create 1 rle with new method : 0.2740163803100586 time for calcul the mask position with numpy : 0.006346464157104492 nb_pixel_total : 14835 time to create 1 rle with old method : 0.0165250301361084 time for calcul the mask position with numpy : 0.007052421569824219 nb_pixel_total : 94143 time to create 1 rle with old method : 0.1456296443939209 time for calcul the mask position with numpy : 0.012650489807128906 nb_pixel_total : 23480 time to create 1 rle with old method : 0.02674555778503418 create new chi : 0.5558710098266602 time to delete rle : 0.0006492137908935547 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3016 TO DO : save crop sub photo not yet done ! save time : 1.3643665313720703 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03983449935913086 time for calcul the mask position with numpy : 0.02803349494934082 nb_pixel_total : 2066602 time to create 1 rle with new method : 0.2791898250579834 time for calcul the mask position with numpy : 0.006352901458740234 nb_pixel_total : 6998 time to create 1 rle with old method : 0.00787806510925293 create new chi : 0.3316524028778076 time to delete rle : 0.0003082752227783203 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1420 TO DO : save crop sub photo not yet done ! save time : 0.867229700088501 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.037526845932006836 time for calcul the mask position with numpy : 0.0979921817779541 nb_pixel_total : 2023167 time to create 1 rle with new method : 0.20706963539123535 time for calcul the mask position with numpy : 0.006821155548095703 nb_pixel_total : 50433 time to create 1 rle with old method : 0.05586957931518555 create new chi : 0.3782479763031006 time to delete rle : 0.0002970695495605469 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1576 TO DO : save crop sub photo not yet done ! save time : 0.24223947525024414 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.5688900947570801 time for calcul the mask position with numpy : 0.05629587173461914 nb_pixel_total : 1938364 time to create 1 rle with new method : 0.2355198860168457 time for calcul the mask position with numpy : 0.010283470153808594 nb_pixel_total : 4381 time to create 1 rle with old method : 0.0049397945404052734 time for calcul the mask position with numpy : 0.006315469741821289 nb_pixel_total : 8042 time to create 1 rle with old method : 0.008777379989624023 time for calcul the mask position with numpy : 0.006702423095703125 nb_pixel_total : 104335 time to create 1 rle with old method : 0.11382412910461426 time for calcul the mask position with numpy : 0.006296873092651367 nb_pixel_total : 18478 time to create 1 rle with old method : 0.020267486572265625 create new chi : 0.4794735908508301 time to delete rle : 0.0005056858062744141 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2892 TO DO : save crop sub photo not yet done ! save time : 0.5408484935760498 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.1497173309326172 time for calcul the mask position with numpy : 0.2505505084991455 nb_pixel_total : 1927984 time to create 1 rle with new method : 0.23965024948120117 time for calcul the mask position with numpy : 0.01039433479309082 nb_pixel_total : 12468 time to create 1 rle with old method : 0.01421666145324707 time for calcul the mask position with numpy : 0.006079435348510742 nb_pixel_total : 2532 time to create 1 rle with old method : 0.0028905868530273438 time for calcul the mask position with numpy : 0.007929563522338867 nb_pixel_total : 125788 time to create 1 rle with old method : 0.1420600414276123 time for calcul the mask position with numpy : 0.01041269302368164 nb_pixel_total : 4828 time to create 1 rle with old method : 0.0533299446105957 create new chi : 0.7479469776153564 time to delete rle : 0.00047397613525390625 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2720 TO DO : save crop sub photo not yet done ! save time : 1.0544869899749756 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.10459184646606445 time for calcul the mask position with numpy : 0.05415821075439453 nb_pixel_total : 1876125 time to create 1 rle with new method : 0.24671244621276855 time for calcul the mask position with numpy : 0.006146430969238281 nb_pixel_total : 4181 time to create 1 rle with old method : 0.004746913909912109 time for calcul the mask position with numpy : 0.00683140754699707 nb_pixel_total : 165119 time to create 1 rle with new method : 0.23210692405700684 time for calcul the mask position with numpy : 0.006150245666503906 nb_pixel_total : 9537 time to create 1 rle with old method : 0.010685443878173828 time for calcul the mask position with numpy : 0.006107330322265625 nb_pixel_total : 12364 time to create 1 rle with old method : 0.013766288757324219 time for calcul the mask position with numpy : 0.006108999252319336 nb_pixel_total : 6274 time to create 1 rle with old method : 0.00712275505065918 create new chi : 0.611283540725708 time to delete rle : 0.0005812644958496094 batch 1 Loaded 11 chid ids of type : 3594 +++++++++++Number RLEs to save : 4107 TO DO : save crop sub photo not yet done ! save time : 1.6819713115692139 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.035016775131225586 time for calcul the mask position with numpy : 0.015127420425415039 nb_pixel_total : 1374172 time to create 1 rle with new method : 0.029049158096313477 time for calcul the mask position with numpy : 0.011089086532592773 nb_pixel_total : 699428 time to create 1 rle with new method : 0.028222084045410156 create new chi : 0.09058332443237305 time to delete rle : 0.00028133392333984375 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2960 TO DO : save crop sub photo not yet done ! save time : 0.41742610931396484 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.2647864818572998 time for calcul the mask position with numpy : 0.2163829803466797 nb_pixel_total : 2059027 time to create 1 rle with new method : 0.0882256031036377 time for calcul the mask position with numpy : 0.006162881851196289 nb_pixel_total : 8350 time to create 1 rle with old method : 0.009565591812133789 time for calcul the mask position with numpy : 0.006227731704711914 nb_pixel_total : 6223 time to create 1 rle with old method : 0.006980419158935547 create new chi : 0.3442647457122803 time to delete rle : 0.00034046173095703125 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1582 TO DO : save crop sub photo not yet done ! save time : 0.3387320041656494 No data in photo_id : 1379915577 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.23102307319641113 time for calcul the mask position with numpy : 0.06858539581298828 nb_pixel_total : 2068654 time to create 1 rle with new method : 0.20287513732910156 time for calcul the mask position with numpy : 0.007964611053466797 nb_pixel_total : 4946 time to create 1 rle with old method : 0.005632877349853516 create new chi : 0.2952706813812256 time to delete rle : 0.00026679039001464844 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1428 TO DO : save crop sub photo not yet done ! save time : 0.2518806457519531 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.28171467781066895 time for calcul the mask position with numpy : 0.19524073600769043 nb_pixel_total : 1951118 time to create 1 rle with new method : 0.07940173149108887 time for calcul the mask position with numpy : 0.006213188171386719 nb_pixel_total : 11034 time to create 1 rle with old method : 0.01386117935180664 time for calcul the mask position with numpy : 0.006918907165527344 nb_pixel_total : 108691 time to create 1 rle with old method : 0.12906765937805176 time for calcul the mask position with numpy : 0.006500244140625 nb_pixel_total : 2757 time to create 1 rle with old method : 0.003072977066040039 create new chi : 0.4512782096862793 time to delete rle : 0.0004279613494873047 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2610 TO DO : save crop sub photo not yet done ! save time : 0.8315756320953369 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.2694060802459717 time for calcul the mask position with numpy : 0.04985690116882324 nb_pixel_total : 1636253 time to create 1 rle with new method : 0.23151683807373047 time for calcul the mask position with numpy : 0.0076732635498046875 nb_pixel_total : 95354 time to create 1 rle with old method : 0.1238243579864502 time for calcul the mask position with numpy : 0.008212566375732422 nb_pixel_total : 330011 time to create 1 rle with new method : 0.25141453742980957 time for calcul the mask position with numpy : 0.0061910152435302734 nb_pixel_total : 9012 time to create 1 rle with old method : 0.0101165771484375 time for calcul the mask position with numpy : 0.00630950927734375 nb_pixel_total : 2970 time to create 1 rle with old method : 0.00703120231628418 create new chi : 0.7148559093475342 time to delete rle : 0.001283884048461914 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 4494 TO DO : save crop sub photo not yet done ! save time : 1.1433169841766357 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.043256521224975586 time for calcul the mask position with numpy : 0.028540372848510742 nb_pixel_total : 1946679 time to create 1 rle with new method : 0.04424881935119629 time for calcul the mask position with numpy : 0.006801128387451172 nb_pixel_total : 126921 time to create 1 rle with old method : 0.14110279083251953 create new chi : 0.22781157493591309 time to delete rle : 0.0003192424774169922 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2168 TO DO : save crop sub photo not yet done ! save time : 1.1165611743927002 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.61197829246521 time for calcul the mask position with numpy : 0.15566325187683105 nb_pixel_total : 1947007 time to create 1 rle with new method : 0.08460593223571777 time for calcul the mask position with numpy : 0.006266593933105469 nb_pixel_total : 4511 time to create 1 rle with old method : 0.005119800567626953 time for calcul the mask position with numpy : 0.0067555904388427734 nb_pixel_total : 5045 time to create 1 rle with old method : 0.005730628967285156 time for calcul the mask position with numpy : 0.006219625473022461 nb_pixel_total : 6709 time to create 1 rle with old method : 0.007623910903930664 time for calcul the mask position with numpy : 0.006811857223510742 nb_pixel_total : 110328 time to create 1 rle with old method : 0.12888097763061523 create new chi : 0.42611241340637207 time to delete rle : 0.0011112689971923828 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2624 TO DO : save crop sub photo not yet done ! save time : 0.9851269721984863 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.05042600631713867 time for calcul the mask position with numpy : 0.34862780570983887 nb_pixel_total : 1953158 time to create 1 rle with new method : 0.15378952026367188 time for calcul the mask position with numpy : 0.0061533451080322266 nb_pixel_total : 6946 time to create 1 rle with old method : 0.007748126983642578 time for calcul the mask position with numpy : 0.0063934326171875 nb_pixel_total : 104956 time to create 1 rle with old method : 0.11441206932067871 time for calcul the mask position with numpy : 0.006346464157104492 nb_pixel_total : 8540 time to create 1 rle with old method : 0.009871244430541992 create new chi : 0.6623713970184326 time to delete rle : 0.0003712177276611328 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2724 TO DO : save crop sub photo not yet done ! save time : 0.8000640869140625 map_output_result : {1379915897: (0.0, 'Should be the crop_list due to order', 0), 1379915808: (0.0, 'Should be the crop_list due to order', 0), 1379915793: (0.0, 'Should be the crop_list due to order', 0), 1379915761: (0.0, 'Should be the crop_list due to order', 0), 1379915739: (0.0, 'Should be the crop_list due to order', 0), 1379915729: (0.0, 'Should be the crop_list due to order', 0), 1379915720: (0.0, 'Should be the crop_list due to order', 0), 1379915603: (0.0, 'Should be the crop_list due to order', 0), 1379915600: (0.0, 'Should be the crop_list due to order', 0), 1379915598: (0.0, 'Should be the crop_list due to order', 0), 1379915596: (0.0, 'Should be the crop_list due to order', 0), 1379915577: (0.0, 'Should be the crop_list due to order', 0.0), 1379915574: (0.0, 'Should be the crop_list due to order', 0), 1379915571: (0.0, 'Should be the crop_list due to order', 0), 1379915563: (0.0, 'Should be the crop_list due to order', 0), 1379915560: (0.0, 'Should be the crop_list due to order', 0), 1379915454: (0.0, 'Should be the crop_list due to order', 0), 1379915437: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1379915897, 1379915808, 1379915793, 1379915761, 1379915739, 1379915729, 1379915720, 1379915603, 1379915600, 1379915598, 1379915596, 1379915577, 1379915574, 1379915571, 1379915563, 1379915560, 1379915454, 1379915437] Looping around the photos to save general results len do output : 18 /1379915897.Didn't retrieve data . /1379915808.Didn't retrieve data . /1379915793.Didn't retrieve data . /1379915761.Didn't retrieve data . /1379915739.Didn't retrieve data . /1379915729.Didn't retrieve data . /1379915720.Didn't retrieve data . /1379915603.Didn't retrieve data . /1379915600.Didn't retrieve data . /1379915598.Didn't retrieve data . /1379915596.Didn't retrieve data . /1379915577.Didn't retrieve data . /1379915574.Didn't retrieve data . /1379915571.Didn't retrieve data . /1379915563.Didn't retrieve data . /1379915560.Didn't retrieve data . /1379915454.Didn't retrieve data . /1379915437.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915897', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915808', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915793', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915761', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915739', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915729', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915720', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915603', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915600', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915598', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915596', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915577', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915574', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915571', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915563', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915560', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915454', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915437', None, None, None, None, None, '3630167') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 54 time used for this insertion : 0.016086101531982422 save_final save missing photos in datou_result : time spend for datou_step_exec : 25.166087865829468 time spend to save output : 0.016676664352416992 total time spend for step 3 : 25.182764530181885 step4:ventilate_hashtags_in_portfolio Fri Aug 29 00:52:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26311682 get user id for portfolio 26311682 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26311682 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','pet_clair','metal','environnement','mal_croppe','flou','autre','pehd','pet_fonce','background')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26311682 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','pet_clair','metal','environnement','mal_croppe','flou','autre','pehd','pet_fonce','background')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26311682 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','carton','pet_clair','metal','environnement','mal_croppe','flou','autre','pehd','pet_fonce','background')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/26311756,26311757,26311758,26311759,26311760,26311761,26311762,26311763,26311764,26311765,26311766?tags=papier,carton,pet_clair,metal,environnement,mal_croppe,flou,autre,pehd,pet_fonce,background Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1379915897, 1379915808, 1379915793, 1379915761, 1379915739, 1379915729, 1379915720, 1379915603, 1379915600, 1379915598, 1379915596, 1379915577, 1379915574, 1379915571, 1379915563, 1379915560, 1379915454, 1379915437] Looping around the photos to save general results len do output : 1 /26311682. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915897', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915808', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915793', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915761', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915739', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915729', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915720', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915603', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915600', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915598', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915596', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915577', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915574', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915571', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915563', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915560', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915454', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915437', None, None, None, None, None, '3630167') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 19 time used for this insertion : 0.018653154373168945 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.09747314453125 time spend to save output : 0.018981456756591797 total time spend for step 4 : 1.1164546012878418 step5:final Fri Aug 29 00:52:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1379915897: ('0.08495456104252402',), 1379915808: ('0.08495456104252402',), 1379915793: ('0.08495456104252402',), 1379915761: ('0.08495456104252402',), 1379915739: ('0.08495456104252402',), 1379915729: ('0.08495456104252402',), 1379915720: ('0.08495456104252402',), 1379915603: ('0.08495456104252402',), 1379915600: ('0.08495456104252402',), 1379915598: ('0.08495456104252402',), 1379915596: ('0.08495456104252402',), 1379915577: ('0.08495456104252402',), 1379915574: ('0.08495456104252402',), 1379915571: ('0.08495456104252402',), 1379915563: ('0.08495456104252402',), 1379915560: ('0.08495456104252402',), 1379915454: ('0.08495456104252402',), 1379915437: ('0.08495456104252402',)} new output for save of step final : {1379915897: ('0.08495456104252402',), 1379915808: ('0.08495456104252402',), 1379915793: ('0.08495456104252402',), 1379915761: ('0.08495456104252402',), 1379915739: ('0.08495456104252402',), 1379915729: ('0.08495456104252402',), 1379915720: ('0.08495456104252402',), 1379915603: ('0.08495456104252402',), 1379915600: ('0.08495456104252402',), 1379915598: ('0.08495456104252402',), 1379915596: ('0.08495456104252402',), 1379915577: ('0.08495456104252402',), 1379915574: ('0.08495456104252402',), 1379915571: ('0.08495456104252402',), 1379915563: ('0.08495456104252402',), 1379915560: ('0.08495456104252402',), 1379915454: ('0.08495456104252402',), 1379915437: ('0.08495456104252402',)} [1379915897, 1379915808, 1379915793, 1379915761, 1379915739, 1379915729, 1379915720, 1379915603, 1379915600, 1379915598, 1379915596, 1379915577, 1379915574, 1379915571, 1379915563, 1379915560, 1379915454, 1379915437] Looping around the photos to save general results len do output : 18 /1379915897.Didn't retrieve data . /1379915808.Didn't retrieve data . /1379915793.Didn't retrieve data . /1379915761.Didn't retrieve data . /1379915739.Didn't retrieve data . /1379915729.Didn't retrieve data . /1379915720.Didn't retrieve data . /1379915603.Didn't retrieve data . /1379915600.Didn't retrieve data . /1379915598.Didn't retrieve data . /1379915596.Didn't retrieve data . /1379915577.Didn't retrieve data . /1379915574.Didn't retrieve data . /1379915571.Didn't retrieve data . /1379915563.Didn't retrieve data . /1379915560.Didn't retrieve data . /1379915454.Didn't retrieve data . /1379915437.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915897', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915808', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915793', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915761', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915739', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915729', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915720', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915603', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915600', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915598', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915596', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915577', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915574', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915571', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915563', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915560', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915454', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915437', None, None, None, None, None, '3630167') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 54 time used for this insertion : 0.02226877212524414 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12779569625854492 time spend to save output : 0.023131132125854492 total time spend for step 5 : 0.15092682838439941 step6:blur_detection Fri Aug 29 00:52:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1756421430_1116062_1379915897_6287219d5d76af24e69d37267aff3a41.jpg resize: (1080, 1920) 1379915897 0.04716026646084645 treat image : temp/1756421430_1116062_1379915808_7e29b6f5583d70d30639cc5797eb3a00.jpg resize: (1080, 1920) 1379915808 0.18557882144977106 treat image : temp/1756421430_1116062_1379915793_2c05c319d1a9b496e3d97eb30a6aa810.jpg resize: (1080, 1920) 1379915793 -1.8288746810893806 treat image : temp/1756421430_1116062_1379915761_5f41bb1de1ce7e81f2a8d96bb4e8ef8f.jpg resize: (1080, 1920) 1379915761 -0.9818784026951614 treat image : temp/1756421430_1116062_1379915739_a0fbda33d10bb1842704fe286e485ed5.jpg resize: (1080, 1920) 1379915739 -0.4688675874470844 treat image : temp/1756421430_1116062_1379915729_48116347aefbff6bbd41b4aee3ced11b.jpg resize: (1080, 1920) 1379915729 0.5688511746200896 treat image : temp/1756421430_1116062_1379915720_50d1f412a5ee8ab1af5460d409c72826.jpg resize: (1080, 1920) 1379915720 -3.5348002341446234 treat image : temp/1756421430_1116062_1379915603_9625c09416c048bc0545d8a81c15b5cd.jpg resize: (1080, 1920) 1379915603 -2.088247995292285 treat image : temp/1756421430_1116062_1379915600_9bffddc5035d8655669f22ad676a89c6.jpg resize: (1080, 1920) 1379915600 -0.8795079891270093 treat image : temp/1756421430_1116062_1379915598_4267fed26486accf7da732a59b5ab74d.jpg resize: (1080, 1920) 1379915598 0.45234446739712175 treat image : temp/1756421430_1116062_1379915596_9f0c49f2454c06ef4b2e7c432346dc46.jpg resize: (1080, 1920) 1379915596 0.37643365568386794 treat image : temp/1756421430_1116062_1379915577_9e8121606b1659279d4c7e8f92c8a3b2.jpg resize: (1080, 1920) 1379915577 2.370769142213085 treat image : temp/1756421430_1116062_1379915574_16959650a14fedc61436778464f818a5.jpg resize: (1080, 1920) 1379915574 1.0825353842162702 treat image : temp/1756421430_1116062_1379915571_6c299f93ceec6f89ed9321a2bc118384.jpg resize: (1080, 1920) 1379915571 -4.929562457014411 treat image : temp/1756421430_1116062_1379915563_686b2efedfcef78608a24899a6143243.jpg resize: (1080, 1920) 1379915563 -0.6479091532636686 treat image : temp/1756421430_1116062_1379915560_5240bb441b41bc29db1d71023d157cf0.jpg resize: (1080, 1920) 1379915560 -4.851962037883332 treat image : temp/1756421430_1116062_1379915454_16fd3ced20175c70de9b40073848218b.jpg resize: (1080, 1920) 1379915454 -3.2653908375926544 treat image : temp/1756421430_1116062_1379915437_10aa2a77b8ae7b2e21e0ad1542b79c5b.jpg resize: (1080, 1920) 1379915437 0.2699224091149927 treat image : temp/1756421430_1116062_1379915897_6287219d5d76af24e69d37267aff3a41_rle_crop_3934844609_0.png resize: (149, 125) 1380007143 -1.106004535706208 treat image : temp/1756421430_1116062_1379915808_7e29b6f5583d70d30639cc5797eb3a00_rle_crop_3934844612_0.png resize: (175, 94) 1380007144 -0.20644982372402587 treat image : temp/1756421430_1116062_1379915793_2c05c319d1a9b496e3d97eb30a6aa810_rle_crop_3934844613_0.png resize: (119, 139) 1380007145 -1.3662390692704578 treat image : temp/1756421430_1116062_1379915761_5f41bb1de1ce7e81f2a8d96bb4e8ef8f_rle_crop_3934844615_0.png resize: (281, 129) 1380007146 -1.408656239580096 treat image : temp/1756421430_1116062_1379915739_a0fbda33d10bb1842704fe286e485ed5_rle_crop_3934844618_0.png resize: (165, 85) 1380007147 -1.763288149292242 treat image : temp/1756421430_1116062_1379915720_50d1f412a5ee8ab1af5460d409c72826_rle_crop_3934844622_0.png resize: (131, 162) 1380007148 -2.9909721402940956 treat image : temp/1756421430_1116062_1379915720_50d1f412a5ee8ab1af5460d409c72826_rle_crop_3934844623_0.png resize: (100, 108) 1380007149 -2.557231154015193 treat image : temp/1756421430_1116062_1379915603_9625c09416c048bc0545d8a81c15b5cd_rle_crop_3934844626_0.png resize: (74, 58) 1380007150 -1.4285565241093496 treat image : temp/1756421430_1116062_1379915600_9bffddc5035d8655669f22ad676a89c6_rle_crop_3934844629_0.png resize: (189, 120) 1380007151 -0.4171437633555807 treat image : temp/1756421430_1116062_1379915596_9f0c49f2454c06ef4b2e7c432346dc46_rle_crop_3934844635_0.png resize: (171, 113) 1380007152 -1.3805446006848554 treat image : temp/1756421430_1116062_1379915596_9f0c49f2454c06ef4b2e7c432346dc46_rle_crop_3934844634_0.png resize: (79, 106) 1380007153 2.479740699274553 treat image : temp/1756421430_1116062_1379915574_16959650a14fedc61436778464f818a5_rle_crop_3934844636_0.png resize: (149, 104) 1380007154 -2.644587542726229 treat image : temp/1756421430_1116062_1379915571_6c299f93ceec6f89ed9321a2bc118384_rle_crop_3934844639_0.png resize: (182, 123) 1380007155 -1.254502526774294 treat image : temp/1756421430_1116062_1379915571_6c299f93ceec6f89ed9321a2bc118384_rle_crop_3934844637_0.png resize: (64, 65) 1380007156 -1.1008665526327608 treat image : temp/1756421430_1116062_1379915563_686b2efedfcef78608a24899a6143243_rle_crop_3934844641_0.png resize: (189, 116) 1380007157 -1.9520963102132465 treat image : temp/1756421430_1116062_1379915563_686b2efedfcef78608a24899a6143243_rle_crop_3934844640_0.png resize: (93, 41) 1380007158 1.2051347525069838 treat image : temp/1756421430_1116062_1379915454_16fd3ced20175c70de9b40073848218b_rle_crop_3934844647_0.png resize: (80, 113) 1380007160 -2.6824380826592624 treat image : temp/1756421430_1116062_1379915437_10aa2a77b8ae7b2e21e0ad1542b79c5b_rle_crop_3934844651_0.png resize: (164, 102) 1380007161 -1.734396952683536 treat image : temp/1756421430_1116062_1379915603_9625c09416c048bc0545d8a81c15b5cd_rle_crop_3934844627_0.png resize: (116, 147) 1380007168 -1.0541558751743494 treat image : temp/1756421430_1116062_1379915600_9bffddc5035d8655669f22ad676a89c6_rle_crop_3934844631_0.png resize: (841, 843) 1380007169 -0.21834804192258253 treat image : temp/1756421430_1116062_1379915454_16fd3ced20175c70de9b40073848218b_rle_crop_3934844648_0.png resize: (77, 78) 1380007170 -0.021118309806594165 treat image : temp/1756421430_1116062_1379915437_10aa2a77b8ae7b2e21e0ad1542b79c5b_rle_crop_3934844649_0.png resize: (101, 148) 1380007171 -1.09650779994526 treat image : temp/1756421430_1116062_1379915897_6287219d5d76af24e69d37267aff3a41_rle_crop_3934844611_0.png resize: (931, 1208) 1380007224 -0.44701442923733925 treat image : temp/1756421430_1116062_1379915897_6287219d5d76af24e69d37267aff3a41_rle_crop_3934844608_0.png resize: (218, 81) 1380007225 -1.6303511237370198 treat image : temp/1756421430_1116062_1379915897_6287219d5d76af24e69d37267aff3a41_rle_crop_3934844610_0.png resize: (130, 106) 1380007228 -3.5308176130186144 treat image : temp/1756421430_1116062_1379915897_6287219d5d76af24e69d37267aff3a41_rle_crop_3934844607_0.png resize: (56, 293) 1380007229 -2.5978822116345617 treat image : temp/1756421430_1116062_1379915793_2c05c319d1a9b496e3d97eb30a6aa810_rle_crop_3934844614_0.png resize: (143, 101) 1380007231 -2.147380221403485 treat image : temp/1756421430_1116062_1379915761_5f41bb1de1ce7e81f2a8d96bb4e8ef8f_rle_crop_3934844617_0.png resize: (150, 150) 1380007232 -3.1808243724137855 treat image : temp/1756421430_1116062_1379915761_5f41bb1de1ce7e81f2a8d96bb4e8ef8f_rle_crop_3934844616_0.png resize: (501, 328) 1380007233 0.19841052231108913 treat image : temp/1756421430_1116062_1379915729_48116347aefbff6bbd41b4aee3ced11b_rle_crop_3934844619_0.png resize: (229, 412) 1380007235 -1.388605592046181 treat image : temp/1756421430_1116062_1379915720_50d1f412a5ee8ab1af5460d409c72826_rle_crop_3934844620_0.png resize: (123, 211) 1380007236 -2.2506097720465457 treat image : temp/1756421430_1116062_1379915720_50d1f412a5ee8ab1af5460d409c72826_rle_crop_3934844621_0.png resize: (549, 321) 1380007237 0.2738506427699249 treat image : temp/1756421430_1116062_1379915603_9625c09416c048bc0545d8a81c15b5cd_rle_crop_3934844624_0.png resize: (79, 88) 1380007239 -4.6356286369577075 treat image : temp/1756421430_1116062_1379915603_9625c09416c048bc0545d8a81c15b5cd_rle_crop_3934844625_0.png resize: (544, 370) 1380007240 0.2800101635812587 treat image : temp/1756421430_1116062_1379915600_9bffddc5035d8655669f22ad676a89c6_rle_crop_3934844632_0.png resize: (78, 79) 1380007242 -3.3845663528701713 treat image : temp/1756421430_1116062_1379915600_9bffddc5035d8655669f22ad676a89c6_rle_crop_3934844628_0.png resize: (69, 109) 1380007244 -4.49911148593713 treat image : temp/1756421430_1116062_1379915600_9bffddc5035d8655669f22ad676a89c6_rle_crop_3934844630_0.png resize: (152, 109) 1380007245 -3.3397599614107536 treat image : temp/1756421430_1116062_1379915598_4267fed26486accf7da732a59b5ab74d_rle_crop_3934844633_0.png resize: (935, 977) 1380007247 0.68753209082442 treat image : temp/1756421430_1116062_1379915571_6c299f93ceec6f89ed9321a2bc118384_rle_crop_3934844638_0.png resize: (518, 336) 1380007248 0.34311682998224224 treat image : temp/1756421430_1116062_1379915563_686b2efedfcef78608a24899a6143243_rle_crop_3934844642_0.png resize: (670, 853) 1380007249 0.4445918299272329 treat image : temp/1756421430_1116062_1379915563_686b2efedfcef78608a24899a6143243_rle_crop_3934844643_0.png resize: (524, 319) 1380007251 -0.36170825712345345 treat image : temp/1756421430_1116062_1379915560_5240bb441b41bc29db1d71023d157cf0_rle_crop_3934844644_0.png resize: (539, 395) 1380007252 -0.14079561930919376 treat image : temp/1756421430_1116062_1379915454_16fd3ced20175c70de9b40073848218b_rle_crop_3934844646_0.png resize: (81, 99) 1380007253 -2.323320964735143 treat image : temp/1756421430_1116062_1379915454_16fd3ced20175c70de9b40073848218b_rle_crop_3934844645_0.png resize: (532, 343) 1380007255 0.34786317635926134 treat image : temp/1756421430_1116062_1379915437_10aa2a77b8ae7b2e21e0ad1542b79c5b_rle_crop_3934844650_0.png resize: (504, 349) 1380007256 -0.01884373714960946 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 63 time used for this insertion : 0.01463007926940918 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 63 time used for this insertion : 0.028908729553222656 save missing photos in datou_result : time spend for datou_step_exec : 15.625121355056763 time spend to save output : 0.04897427558898926 total time spend for step 6 : 15.674095630645752 step7:brightness Fri Aug 29 00:52:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1756421430_1116062_1379915897_6287219d5d76af24e69d37267aff3a41.jpg treat image : temp/1756421430_1116062_1379915808_7e29b6f5583d70d30639cc5797eb3a00.jpg treat image : temp/1756421430_1116062_1379915793_2c05c319d1a9b496e3d97eb30a6aa810.jpg treat image : temp/1756421430_1116062_1379915761_5f41bb1de1ce7e81f2a8d96bb4e8ef8f.jpg treat image : temp/1756421430_1116062_1379915739_a0fbda33d10bb1842704fe286e485ed5.jpg treat image : temp/1756421430_1116062_1379915729_48116347aefbff6bbd41b4aee3ced11b.jpg treat image : temp/1756421430_1116062_1379915720_50d1f412a5ee8ab1af5460d409c72826.jpg treat image : temp/1756421430_1116062_1379915603_9625c09416c048bc0545d8a81c15b5cd.jpg treat image : temp/1756421430_1116062_1379915600_9bffddc5035d8655669f22ad676a89c6.jpg treat image : temp/1756421430_1116062_1379915598_4267fed26486accf7da732a59b5ab74d.jpg treat image : temp/1756421430_1116062_1379915596_9f0c49f2454c06ef4b2e7c432346dc46.jpg treat image : temp/1756421430_1116062_1379915577_9e8121606b1659279d4c7e8f92c8a3b2.jpg treat image : temp/1756421430_1116062_1379915574_16959650a14fedc61436778464f818a5.jpg treat image : temp/1756421430_1116062_1379915571_6c299f93ceec6f89ed9321a2bc118384.jpg treat image : temp/1756421430_1116062_1379915563_686b2efedfcef78608a24899a6143243.jpg treat image : temp/1756421430_1116062_1379915560_5240bb441b41bc29db1d71023d157cf0.jpg treat image : temp/1756421430_1116062_1379915454_16fd3ced20175c70de9b40073848218b.jpg treat image : temp/1756421430_1116062_1379915437_10aa2a77b8ae7b2e21e0ad1542b79c5b.jpg treat image : temp/1756421430_1116062_1379915897_6287219d5d76af24e69d37267aff3a41_rle_crop_3934844609_0.png treat image : temp/1756421430_1116062_1379915808_7e29b6f5583d70d30639cc5797eb3a00_rle_crop_3934844612_0.png treat image : temp/1756421430_1116062_1379915793_2c05c319d1a9b496e3d97eb30a6aa810_rle_crop_3934844613_0.png treat image : temp/1756421430_1116062_1379915761_5f41bb1de1ce7e81f2a8d96bb4e8ef8f_rle_crop_3934844615_0.png treat image : temp/1756421430_1116062_1379915739_a0fbda33d10bb1842704fe286e485ed5_rle_crop_3934844618_0.png treat image : temp/1756421430_1116062_1379915720_50d1f412a5ee8ab1af5460d409c72826_rle_crop_3934844622_0.png treat image : temp/1756421430_1116062_1379915720_50d1f412a5ee8ab1af5460d409c72826_rle_crop_3934844623_0.png treat image : temp/1756421430_1116062_1379915603_9625c09416c048bc0545d8a81c15b5cd_rle_crop_3934844626_0.png treat image : temp/1756421430_1116062_1379915600_9bffddc5035d8655669f22ad676a89c6_rle_crop_3934844629_0.png treat image : temp/1756421430_1116062_1379915596_9f0c49f2454c06ef4b2e7c432346dc46_rle_crop_3934844635_0.png treat image : temp/1756421430_1116062_1379915596_9f0c49f2454c06ef4b2e7c432346dc46_rle_crop_3934844634_0.png treat image : temp/1756421430_1116062_1379915574_16959650a14fedc61436778464f818a5_rle_crop_3934844636_0.png treat image : temp/1756421430_1116062_1379915571_6c299f93ceec6f89ed9321a2bc118384_rle_crop_3934844639_0.png treat image : temp/1756421430_1116062_1379915571_6c299f93ceec6f89ed9321a2bc118384_rle_crop_3934844637_0.png treat image : temp/1756421430_1116062_1379915563_686b2efedfcef78608a24899a6143243_rle_crop_3934844641_0.png treat image : temp/1756421430_1116062_1379915563_686b2efedfcef78608a24899a6143243_rle_crop_3934844640_0.png treat image : temp/1756421430_1116062_1379915454_16fd3ced20175c70de9b40073848218b_rle_crop_3934844647_0.png treat image : temp/1756421430_1116062_1379915437_10aa2a77b8ae7b2e21e0ad1542b79c5b_rle_crop_3934844651_0.png treat image : temp/1756421430_1116062_1379915603_9625c09416c048bc0545d8a81c15b5cd_rle_crop_3934844627_0.png treat image : temp/1756421430_1116062_1379915600_9bffddc5035d8655669f22ad676a89c6_rle_crop_3934844631_0.png treat image : temp/1756421430_1116062_1379915454_16fd3ced20175c70de9b40073848218b_rle_crop_3934844648_0.png treat image : temp/1756421430_1116062_1379915437_10aa2a77b8ae7b2e21e0ad1542b79c5b_rle_crop_3934844649_0.png treat image : temp/1756421430_1116062_1379915897_6287219d5d76af24e69d37267aff3a41_rle_crop_3934844611_0.png treat image : temp/1756421430_1116062_1379915897_6287219d5d76af24e69d37267aff3a41_rle_crop_3934844608_0.png treat image : temp/1756421430_1116062_1379915897_6287219d5d76af24e69d37267aff3a41_rle_crop_3934844610_0.png treat image : temp/1756421430_1116062_1379915897_6287219d5d76af24e69d37267aff3a41_rle_crop_3934844607_0.png treat image : temp/1756421430_1116062_1379915793_2c05c319d1a9b496e3d97eb30a6aa810_rle_crop_3934844614_0.png treat image : temp/1756421430_1116062_1379915761_5f41bb1de1ce7e81f2a8d96bb4e8ef8f_rle_crop_3934844617_0.png treat image : temp/1756421430_1116062_1379915761_5f41bb1de1ce7e81f2a8d96bb4e8ef8f_rle_crop_3934844616_0.png treat image : temp/1756421430_1116062_1379915729_48116347aefbff6bbd41b4aee3ced11b_rle_crop_3934844619_0.png treat image : temp/1756421430_1116062_1379915720_50d1f412a5ee8ab1af5460d409c72826_rle_crop_3934844620_0.png treat image : temp/1756421430_1116062_1379915720_50d1f412a5ee8ab1af5460d409c72826_rle_crop_3934844621_0.png treat image : temp/1756421430_1116062_1379915603_9625c09416c048bc0545d8a81c15b5cd_rle_crop_3934844624_0.png treat image : temp/1756421430_1116062_1379915603_9625c09416c048bc0545d8a81c15b5cd_rle_crop_3934844625_0.png treat image : temp/1756421430_1116062_1379915600_9bffddc5035d8655669f22ad676a89c6_rle_crop_3934844632_0.png treat image : temp/1756421430_1116062_1379915600_9bffddc5035d8655669f22ad676a89c6_rle_crop_3934844628_0.png treat image : temp/1756421430_1116062_1379915600_9bffddc5035d8655669f22ad676a89c6_rle_crop_3934844630_0.png treat image : temp/1756421430_1116062_1379915598_4267fed26486accf7da732a59b5ab74d_rle_crop_3934844633_0.png treat image : temp/1756421430_1116062_1379915571_6c299f93ceec6f89ed9321a2bc118384_rle_crop_3934844638_0.png treat image : temp/1756421430_1116062_1379915563_686b2efedfcef78608a24899a6143243_rle_crop_3934844642_0.png treat image : temp/1756421430_1116062_1379915563_686b2efedfcef78608a24899a6143243_rle_crop_3934844643_0.png treat image : temp/1756421430_1116062_1379915560_5240bb441b41bc29db1d71023d157cf0_rle_crop_3934844644_0.png treat image : temp/1756421430_1116062_1379915454_16fd3ced20175c70de9b40073848218b_rle_crop_3934844646_0.png treat image : temp/1756421430_1116062_1379915454_16fd3ced20175c70de9b40073848218b_rle_crop_3934844645_0.png treat image : temp/1756421430_1116062_1379915437_10aa2a77b8ae7b2e21e0ad1542b79c5b_rle_crop_3934844650_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 63 time used for this insertion : 0.013423442840576172 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 63 time used for this insertion : 0.5390655994415283 save missing photos in datou_result : time spend for datou_step_exec : 4.471809387207031 time spend to save output : 0.5576016902923584 total time spend for step 7 : 5.02941107749939 step8:velours_tree Fri Aug 29 00:52:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.13259005546569824 time spend to save output : 6.794929504394531e-05 total time spend for step 8 : 0.1326580047607422 step9:send_mail_cod Fri Aug 29 00:52:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26311682_29-08-2025_00_52_24.pdf 26311756 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette263117561756421544 26311757 change filename to text .change filename to text .change filename to text .change filename to text .imagette263117571756421545 26311758 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette263117581756421546 26311759 imagette263117591756421547 26311761 imagette263117611756421547 26311762 imagette263117621756421547 26311763 imagette263117631756421547 26311764 imagette263117641756421547 26311765 imagette263117651756421547 26311766 imagette263117661756421547 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26311682 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/26311756,26311757,26311758,26311759,26311760,26311761,26311762,26311763,26311764,26311765,26311766?tags=papier,carton,pet_clair,metal,environnement,mal_croppe,flou,autre,pehd,pet_fonce,background args[1379915897] : ((1379915897, 0.04716026646084645, 492688767), (1379915897, 0.3934402541814784, 2107752395), '0.08495456104252402') We are sending mail with results at report@fotonower.com args[1379915808] : ((1379915808, 0.18557882144977106, 492688767), (1379915808, 0.5531737930929144, 2107752395), '0.08495456104252402') We are sending mail with results at report@fotonower.com args[1379915793] : ((1379915793, -1.8288746810893806, 492688767), (1379915793, 0.6298774012231696, 2107752395), '0.08495456104252402') We are sending mail with results at report@fotonower.com args[1379915761] : ((1379915761, -0.9818784026951614, 492688767), (1379915761, 0.9972763214181741, 2107752395), '0.08495456104252402') We are sending mail with results at report@fotonower.com args[1379915739] : ((1379915739, -0.4688675874470844, 492688767), (1379915739, 0.6070641729919554, 2107752395), '0.08495456104252402') We are sending mail with results at report@fotonower.com args[1379915729] : ((1379915729, 0.5688511746200896, 492688767), (1379915729, 0.7775665175678187, 2107752395), '0.08495456104252402') We are sending mail with results at report@fotonower.com args[1379915720] : ((1379915720, -3.5348002341446234, 492609224), (1379915720, 0.434439668358669, 2107752395), '0.08495456104252402') We are sending mail with results at report@fotonower.com args[1379915603] : ((1379915603, -2.088247995292285, 492609224), (1379915603, 0.36276110883164114, 2107752395), '0.08495456104252402') We are sending mail with results at report@fotonower.com args[1379915600] : ((1379915600, -0.8795079891270093, 492688767), (1379915600, 0.4327480932678552, 2107752395), '0.08495456104252402') We are sending mail with results at report@fotonower.com args[1379915598] : ((1379915598, 0.45234446739712175, 492688767), (1379915598, 0.6254434953392339, 2107752395), '0.08495456104252402') We are sending mail with results at report@fotonower.com args[1379915596] : ((1379915596, 0.37643365568386794, 492688767), (1379915596, 1.1833192278675628, 2107752395), '0.08495456104252402') We are sending mail with results at report@fotonower.com args[1379915577] : ((1379915577, 2.370769142213085, 492688767), (1379915577, 0.7559315930771779, 2107752395), '0.08495456104252402') We are sending mail with results at report@fotonower.com args[1379915574] : ((1379915574, 1.0825353842162702, 492688767), (1379915574, 0.8074865388349883, 2107752395), '0.08495456104252402') We are sending mail with results at report@fotonower.com args[1379915571] : ((1379915571, -4.929562457014411, 492609224), (1379915571, 0.5527160936142431, 2107752395), '0.08495456104252402') We are sending mail with results at report@fotonower.com args[1379915563] : ((1379915563, -0.6479091532636686, 492688767), (1379915563, 0.7678263043116981, 2107752395), '0.08495456104252402') We are sending mail with results at report@fotonower.com args[1379915560] : ((1379915560, -4.851962037883332, 492609224), (1379915560, 0.5142752341937957, 2107752395), '0.08495456104252402') We are sending mail with results at report@fotonower.com args[1379915454] : ((1379915454, -3.2653908375926544, 492609224), (1379915454, 0.515428390530224, 2107752395), '0.08495456104252402') We are sending mail with results at report@fotonower.com args[1379915437] : ((1379915437, 0.2699224091149927, 492688767), (1379915437, 0.6622620474889472, 2107752395), '0.08495456104252402') We are sending mail with results at report@fotonower.com refus_total : 0.08495456104252402 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26311682 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26311682_29-08-2025_00_52_24.pdf results_Auto_P26311682_29-08-2025_00_52_24.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26311682_29-08-2025_00_52_24.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26311682','results_Auto_P26311682_29-08-2025_00_52_24.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26311682_29-08-2025_00_52_24.pdf','pdf','','0.46','0.08495456104252402') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26311682

https://www.fotonower.com/image?json=false&list_photos_id=1379915897
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379915808
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379915793
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379915761
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379915739
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379915729
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379915720
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379915603
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379915600
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379915598
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379915596
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379915577
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.370769142213085)
https://www.fotonower.com/image?json=false&list_photos_id=1379915574
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.0825353842162702)
https://www.fotonower.com/image?json=false&list_photos_id=1379915571
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379915563
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379915560
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379915454
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1379915437
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 8.50%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/26311756?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26311757?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26311758?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26311682_29-08-2025_00_52_24.pdf.

Lien vers velours :https://www.fotonower.com/velours/26311756,26311757,26311758,26311759,26311760,26311761,26311762,26311763,26311764,26311765,26311766?tags=papier,carton,pet_clair,metal,environnement,mal_croppe,flou,autre,pehd,pet_fonce,background.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 28 Aug 2025 22:52:29 GMT Content-Length: 0 Connection: close X-Message-Id: NSloWvD1T_mpTalQCZEXFQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1379915897, 1379915808, 1379915793, 1379915761, 1379915739, 1379915729, 1379915720, 1379915603, 1379915600, 1379915598, 1379915596, 1379915577, 1379915574, 1379915571, 1379915563, 1379915560, 1379915454, 1379915437] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915897', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915808', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915793', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915761', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915739', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915729', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915720', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915603', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915600', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915598', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915596', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915577', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915574', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915571', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915563', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915560', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915454', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915437', None, None, None, None, None, '3630167') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.014498472213745117 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.179942607879639 time spend to save output : 0.01493692398071289 total time spend for step 9 : 5.194879531860352 step10:split_time_score Fri Aug 29 00:52:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 18),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 28082025 26311682 Nombre de photos uploadées : 18 / 23040 (0%) 28082025 26311682 Nombre de photos taguées (types de déchets): 0 / 18 (0%) 28082025 26311682 Nombre de photos taguées (volume) : 0 / 18 (0%) elapsed_time : load_data_split_time_score 3.5762786865234375e-06 elapsed_time : order_list_meta_photo_and_scores 7.867813110351562e-06 ?????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0009140968322753906 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.24503421783447266 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.19486290616426608 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26288806_28-08-2025_09_53_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26288806 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26288806 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26311624 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26311626 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26311630 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26311632 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26311634 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26311656 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26311658 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26311680 order by id desc limit 1 Qualite : 0.08495456104252402 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26311682_29-08-2025_00_52_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26311682 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26311682 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'28082025': {'nb_upload': 18, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1379915897, 1379915808, 1379915793, 1379915761, 1379915739, 1379915729, 1379915720, 1379915603, 1379915600, 1379915598, 1379915596, 1379915577, 1379915574, 1379915571, 1379915563, 1379915560, 1379915454, 1379915437] Looping around the photos to save general results len do output : 1 /26311682Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915897', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915808', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915793', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915761', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915739', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915729', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915720', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915603', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915600', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915598', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915596', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915577', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915574', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915571', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915563', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915560', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915454', None, None, None, None, None, '3630167') ('3318', None, None, None, None, None, None, None, '3630167') ('3318', '26311682', '1379915437', None, None, None, None, None, '3630167') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 19 time used for this insertion : 0.02012014389038086 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.390486717224121 time spend to save output : 0.02044224739074707 total time spend for step 10 : 8.410928964614868 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 18 set_done_treatment 60.13user 27.46system 2:13.25elapsed 65%CPU (0avgtext+0avgdata 2936000maxresident)k 520904inputs+30896outputs (190major+2119808minor)pagefaults 0swaps